2026-03-27 16:30:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 16:30:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 16:30:05 [ayvens.it] INFO: Starting spider ayvens.it
2026-03-27 16:30:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 16:30:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 16:30:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 16:30:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 16:30:05 [scrapy.extensions.telnet] INFO: Telnet Password: 4b8e6842a366032b
2026-03-27 16:30:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-27 16:30:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.it/task_39_2026-03-27T16_30_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-27 16:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 16:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 16:30:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 16:30:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 16:30:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 16:30:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 16:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 16:30:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-27 16:30:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 16:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 16:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-27 16:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-27 16:30:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 16:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 16:30:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 16:30:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 16:30:05 [scrapy.core.engine] INFO: Spider opened
2026-03-27 16:30:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 16:30:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 16:30:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-27 16:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-27 16:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-27 16:30:10 [scrapy-playwright] INFO: Launching browser firefox
2026-03-27 16:30:11 [scrapy-playwright] INFO: Browser firefox launched
2026-03-27 16:30:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-27 16:30:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-27 16:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 16:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 16:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 16:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-27 16:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-27 16:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-27 16:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-27 16:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-27 16:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-27 16:30:18 [ayvens.it] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'nwe+isv8+BGZZMuKCI8O++|2026-03-27T16:30:16.195Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806165016, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'Gbnq+mALjZuhlIBiGrDQNJ|1774629018124|1774629018124', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774630818, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-27 16:30:18 [ayvens.it] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'nwe+isv8+BGZZMuKCI8O++|2026-03-27T16:30:16.195Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'Gbnq+mALjZuhlIBiGrDQNJ|1774629018124|1774629018124', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-27 16:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-27 16:30:18 [ayvens.it] INFO: Intercepting token...
2026-03-27 16:30:18 [ayvens.it] INFO: Scrolling element to trigger lazy load...
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/camera-icon.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/gr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/reset.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/it.svg>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/camera-icon.svg>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/gr.svg>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/fr.svg>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/reset.svg>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/xzi/29a59c0370b14b4e8f0a88a8e324de96/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7c4941f0a9ef42db93437be323911fff/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-27 16:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/xzi/29a59c0370b14b4e8f0a88a8e324de96/images/medium/0.jpg>
2026-03-27 16:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/7c4941f0a9ef42db93437be323911fff/images/medium/0.jpg>
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/lu.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/lu.svg>
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-27 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-27 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-27 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css>
2026-03-27 16:30:23 [ayvens.it] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg>
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png>
2026-03-27 16:30:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/powered_by_logo.svg>
2026-03-27 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744>
2026-03-27 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=DC-4340043&cx=c>m=4e63p1> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=G-2R31MHSGCW&cx=c>m=4e63p1> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/372422ca89af404b029558678c4f42fd.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtag/destination?id=DC-4340043&cx=c>m=4e63p1>
2026-03-27 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtag/destination?id=G-2R31MHSGCW&cx=c>m=4e63p1>
2026-03-27 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=5930179523318;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=394912883.1774629025;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63p1v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=0~115616985~115938465~115938468~117484252;epver=2;dc_random=1774629024_lwHny-ENk17U-1ZwHm1HVejgmh2hWNunwA;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=5930179523318;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=394912883.1774629025;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63p1v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115616985~115938465~115938468~117484252;epver=2;dc_random=1774629024_lwHny-ENk17U-1ZwHm1HVejgmh2hWNunwA;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=5312241597535;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=394912883.1774629025;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63p1v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=0~115616985~115938465~115938468~117484252;epver=2;dc_random=1774629024__QOHrh2RDPMrleIguviYLJSw-Zo0AG-pvg;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=5312241597535;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=394912883.1774629025;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63p1v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115616985~115938465~115938468~117484252;epver=2;dc_random=1774629024__QOHrh2RDPMrleIguviYLJSw-Zo0AG-pvg;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=9213512545243;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=394912883.1774629025;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63p1v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=3;tag_exp=0~115616985~115938465~115938468~117484252;epver=2;dc_random=1774629024_Xj6rdFwZTBVhBdzz2vpQamZ6ZFpOoFeRaA;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=9213512545243;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=394912883.1774629025;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe63p1v9241271965z877415155za20gzb77415155zd77415155xea;gcd=13l3l3l3l1l1;dma=0;dc_fmt=2;tag_exp=0~115616985~115938465~115938468~117484252;epver=2;dc_random=1774629024_Xj6rdFwZTBVhBdzz2vpQamZ6ZFpOoFeRaA;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/372422ca89af404b029558678c4f42fd.js>
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/commons.1818bf8cd18dc6e0da8b.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/372422ca89af404b029558678c4f42fd/main.62f3e2b80275d2c67f53.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/me.42217d3094fdefbb5607.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/jquery.5434730a34a3135b52f6.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://region1.analytics.google.com/g/collect?v=2&tid=G-2R31MHSGCW>m=45je63p1v877189330z877415155za20gzb77415155zd77415155&_p=1774629023209&_gaz=1&gcd=13l3l3l3l1l1&npa=0&dma=0&cid=1865251911.1774629025&ul=en-us&sr=1280x720&frm=0&pscdl=noapi&_eu=AAAAAGA&_s=1&tag_exp=0~115938465~115938468~117484252&sid=1774629025&sct=1&seg=0&dl=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots&dt=Used%20cars%20lots%20for%20sale%20-%20car%20auctions%20for%20dealers%20and%20traders%20%7C%20Ayvens%20Carmarket&_tu=KA&en=lots_page_view&_fv=1&_nsi=1&_ss=1&ep.site_country_event=gbr&ep.user_country_event=&ep.environment_event=prd&ep.page_name_event=%2Fen-gb%2Flots&ep.error_code_event=&ep.contains_error_event=false&ep.contains_user_info_event=false&ep.language_event=eng&ep.sale_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20null&ep.ic_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined&epn.countdown_event=226783&up.user_country=&up.contains_user_info=false&up.language=eng&tfd=12797> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://stats.g.doubleclick.net/g/collect?v=2&tid=G-2R31MHSGCW&cid=1865251911.1774629025>m=45je63p1v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=0~115938465~115938468~117484252> (resource type: other, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [ayvens.it] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-27 16:30:25 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.google.co.uk/ads/ga-audiences?v=1&t=sr&slf_rd=1&_r=4&tid=G-2R31MHSGCW&cid=1865251911.1774629025>m=45je63p1v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcd=13l3l3l3l1l1&npa=0&frm=0&tag_exp=0~115938465~115938468~117484252&z=754531626> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/shared/commons.1818bf8cd18dc6e0da8b.js>
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/372422ca89af404b029558678c4f42fd/main.62f3e2b80275d2c67f53.js>
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/shared/me.42217d3094fdefbb5607.js>
2026-03-27 16:30:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/shared/jquery.5434730a34a3135b52f6.js>
2026-03-27 16:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:30:28 [ayvens.it] INFO: Found listing with ID: 1988808
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988808%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [ayvens.it] INFO: Scrape type for 1988808: 1
2026-03-27 16:30:28 [ayvens.it] INFO: Extracting data for car ID: 1988808
2026-03-27 16:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215866c0-86da-5185-9f9a-e91997bec542 with identifier: 1988808
2026-03-27 16:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215866c0-86da-5185-9f9a-e91997bec542 with scrape type 1
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/1.jpg not downloaded yet
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/2.jpg not downloaded yet
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/3.jpg not downloaded yet
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/4.jpg not downloaded yet
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/5.jpg not downloaded yet
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/6.jpg not downloaded yet
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/7.jpg not downloaded yet
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/8.jpg not downloaded yet
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/9.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/10.jpg not downloaded yet
2026-03-27 16:30:29 [ayvens.it] INFO: Found listing with ID: 1988809
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988809%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [ayvens.it] INFO: Scrape type for 1988809: 1
2026-03-27 16:30:29 [ayvens.it] INFO: Extracting data for car ID: 1988809
2026-03-27 16:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with identifier: 1988809
2026-03-27 16:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with scrape type 1
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/1.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/2.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/3.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/4.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/5.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/6.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/7.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/8.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/9.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/10.jpg not downloaded yet
2026-03-27 16:30:29 [ayvens.it] INFO: Found listing with ID: 1988810
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988810%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [ayvens.it] INFO: Scrape type for 1988810: 1
2026-03-27 16:30:29 [ayvens.it] INFO: Extracting data for car ID: 1988810
2026-03-27 16:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c177257-1c73-51bb-b806-938c6ae3fc43 with identifier: 1988810
2026-03-27 16:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c177257-1c73-51bb-b806-938c6ae3fc43 with scrape type 1
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/1.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/2.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/3.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/4.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/5.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/6.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/7.jpg not downloaded yet
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/8.jpg not downloaded yet
2026-03-27 16:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/9.jpg not downloaded yet
2026-03-27 16:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/10.jpg not downloaded yet
2026-03-27 16:30:29 [ayvens.it] INFO: Found listing with ID: 1988811
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988811%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [ayvens.it] INFO: Scrape type for 1988811: 1
2026-03-27 16:30:29 [ayvens.it] INFO: Extracting data for car ID: 1988811
2026-03-27 16:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdd407b6-8e91-5c73-9da7-3cc29a52df4c with identifier: 1988811
2026-03-27 16:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c with scrape type 1
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/1.jpg not downloaded yet
2026-03-27 16:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/2.jpg not downloaded yet
2026-03-27 16:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/3.jpg not downloaded yet
2026-03-27 16:30:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 16:30:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 16:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7ca90>
2026-03-27 16:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 16:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/3.jpg saved to cache
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/4.jpg not downloaded yet
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acd5d0>
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/7.jpg saved to cache
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/5.jpg not downloaded yet
2026-03-27 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/6.jpg not downloaded yet
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f8c50>
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/5.jpg saved to cache
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c08450>
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/2.jpg saved to cache
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a6aad0>
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/6.jpg saved to cache
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4ae50>
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/8.jpg saved to cache
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/7.jpg not downloaded yet
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/8.jpg not downloaded yet
2026-03-27 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba0710>
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/4.jpg saved to cache
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b67790>
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/1.jpg saved to cache
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/9.jpg not downloaded yet
2026-03-27 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/10.jpg not downloaded yet
2026-03-27 16:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:30 [ayvens.it] INFO: Found listing with ID: 1988812
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988812%27 HTTP/1.1" 200 None
2026-03-27 16:30:30 [ayvens.it] INFO: Scrape type for 1988812: 1
2026-03-27 16:30:30 [ayvens.it] INFO: Extracting data for car ID: 1988812
2026-03-27 16:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46cbf40b-05e5-549a-9854-2629ad765fd1 with identifier: 1988812
2026-03-27 16:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46cbf40b-05e5-549a-9854-2629ad765fd1 with scrape type 1
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/1.jpg not downloaded yet
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdd9d0>
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/10.jpg saved to cache
2026-03-27 16:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/2.jpg not downloaded yet
2026-03-27 16:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/3.jpg not downloaded yet
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba9810>
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl8%252F096a9b7f4906454ebb7b9a36047e4fa7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/9.jpg saved to cache
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 215866c0-86da-5185-9f9a-e91997bec542
2026-03-27 16:30:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 215866c0-86da-5185-9f9a-e91997bec542, skipping ID generation
2026-03-27 16:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215866c0-86da-5185-9f9a-e91997bec542 with scrape type 1
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 215866c0-86da-5185-9f9a-e91997bec542 sending to next pipeline
2026-03-27 16:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 215866c0-86da-5185-9f9a-e91997bec542, identifier: 1988808
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acc710>
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/3.jpg saved to cache
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0f790>
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/1.jpg saved to cache
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa26690>
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/2.jpg saved to cache
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d362d0>
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/4.jpg saved to cache
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b1d0290>
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/5.jpg saved to cache
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/4.jpg not downloaded yet
2026-03-27 16:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 215866c0-86da-5185-9f9a-e91997bec542 with identifier: 1988808
2026-03-27 16:30:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 215866c0-86da-5185-9f9a-e91997bec542 with identifier: 1988808
2026-03-27 16:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 215866c0-86da-5185-9f9a-e91997bec542 with identifier: 1988808 to the API
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '215866c0-86da-5185-9f9a-e91997bec542',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 121077,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700960,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655302,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_215866c0-86da-5185-9f9a-e91997bec542/215866c0-86da-5185-9f9a-e91997bec542_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562962,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl8/096a9b7f4906454ebb7b9a36047e4fa7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988808%27 HTTP/1.1" 200 None
2026-03-27 16:30:32 [ayvens.it] INFO: Saving data for 1988808: {'created_time': 1774629032.588187, 'last_price_update_time': 1774629032.5882, 'auction_closing_time': 1774944000.0}
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988808') HTTP/1.1" 204 0
2026-03-27 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/5.jpg not downloaded yet
2026-03-27 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/6.jpg not downloaded yet
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d10150>
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/6.jpg saved to cache
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/7.jpg not downloaded yet
2026-03-27 16:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/8.jpg not downloaded yet
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af5d50>
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/8.jpg saved to cache
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7d850>
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/10.jpg saved to cache
2026-03-27 16:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c08910>
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/9.jpg saved to cache
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c56bd0>
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/7.jpg saved to cache
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/9.jpg not downloaded yet
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/10.jpg not downloaded yet
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [ayvens.it] INFO: Found listing with ID: 1988813
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988813%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [ayvens.it] INFO: Scrape type for 1988813: 1
2026-03-27 16:30:33 [ayvens.it] INFO: Extracting data for car ID: 1988813
2026-03-27 16:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 107fcdee-cdc7-5ebf-9f87-73779d89e868 with identifier: 1988813
2026-03-27 16:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107fcdee-cdc7-5ebf-9f87-73779d89e868 with scrape type 1
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/1.jpg not downloaded yet
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b67250>
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/2.jpg saved to cache
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/2.jpg not downloaded yet
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/3.jpg not downloaded yet
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c5990>
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/1.jpg saved to cache
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d22610>
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/4.jpg saved to cache
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cce9d0>
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/5.jpg saved to cache
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca1a10>
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/7.jpg saved to cache
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/4.jpg not downloaded yet
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/5.jpg not downloaded yet
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/6.jpg not downloaded yet
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c22a90>
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/8.jpg saved to cache
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b316850>
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/9.jpg saved to cache
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/7.jpg not downloaded yet
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/8.jpg not downloaded yet
2026-03-27 16:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bed410>
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/6.jpg saved to cache
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69516450>
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/6.jpg saved to cache
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc4790>
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/2.jpg saved to cache
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/9.jpg not downloaded yet
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/10.jpg not downloaded yet
2026-03-27 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:34 [ayvens.it] INFO: Found listing with ID: 1988814
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988814%27 HTTP/1.1" 200 None
2026-03-27 16:30:34 [ayvens.it] INFO: Scrape type for 1988814: 1
2026-03-27 16:30:34 [ayvens.it] INFO: Extracting data for car ID: 1988814
2026-03-27 16:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c77e5459-e2b5-538c-871b-23b89632c540 with identifier: 1988814
2026-03-27 16:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c77e5459-e2b5-538c-871b-23b89632c540 with scrape type 1
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/1.jpg not downloaded yet
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa22f10>
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/10.jpg saved to cache
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c36d10>
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Faa24c84823ba4259bf393844a84d7293%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/3.jpg saved to cache
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c
2026-03-27 16:30:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdd407b6-8e91-5c73-9da7-3cc29a52df4c, skipping ID generation
2026-03-27 16:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c with scrape type 1
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdd407b6-8e91-5c73-9da7-3cc29a52df4c sending to next pipeline
2026-03-27 16:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fdd407b6-8e91-5c73-9da7-3cc29a52df4c, identifier: 1988811
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690732d0>
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/4.jpg saved to cache
2026-03-27 16:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fdd407b6-8e91-5c73-9da7-3cc29a52df4c with identifier: 1988811
2026-03-27 16:30:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fdd407b6-8e91-5c73-9da7-3cc29a52df4c with identifier: 1988811
2026-03-27 16:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fdd407b6-8e91-5c73-9da7-3cc29a52df4c with identifier: 1988811 to the API
2026-03-27 16:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'fdd407b6-8e91-5c73-9da7-3cc29a52df4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv S 4WD aut. Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 49382,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 45,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 725543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582975,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd407b6-8e91-5c73-9da7-3cc29a52df4c/fdd407b6-8e91-5c73-9da7-3cc29a52df4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/aa24c84823ba4259bf393844a84d7293/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv S 4WD aut. '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988811%27 HTTP/1.1" 200 None
2026-03-27 16:30:35 [ayvens.it] INFO: Saving data for 1988811: {'created_time': 1774629035.348409, 'last_price_update_time': 1774629035.34842, 'auction_closing_time': 1774944000.0}
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988811') HTTP/1.1" 204 0
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/2.jpg not downloaded yet
2026-03-27 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/3.jpg not downloaded yet
2026-03-27 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0e9d0>
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/5.jpg saved to cache
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c7bd50>
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/7.jpg saved to cache
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb4e50>
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/3.jpg saved to cache
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b33d50>
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/1.jpg saved to cache
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/4.jpg not downloaded yet
2026-03-27 16:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/5.jpg not downloaded yet
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8eed0>
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/9.jpg saved to cache
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c09590>
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/6.jpg saved to cache
2026-03-27 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68610250>
2026-03-27 16:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/8.jpg saved to cache
2026-03-27 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/6.jpg not downloaded yet
2026-03-27 16:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ae9490>
2026-03-27 16:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F76ac775b34364722bc4a89d233d1e621%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/10.jpg saved to cache
2026-03-27 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46cbf40b-05e5-549a-9854-2629ad765fd1
2026-03-27 16:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46cbf40b-05e5-549a-9854-2629ad765fd1, skipping ID generation
2026-03-27 16:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46cbf40b-05e5-549a-9854-2629ad765fd1 with scrape type 1
2026-03-27 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46cbf40b-05e5-549a-9854-2629ad765fd1 sending to next pipeline
2026-03-27 16:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 46cbf40b-05e5-549a-9854-2629ad765fd1, identifier: 1988812
2026-03-27 16:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/7.jpg not downloaded yet
2026-03-27 16:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 46cbf40b-05e5-549a-9854-2629ad765fd1 with identifier: 1988812
2026-03-27 16:30:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 46cbf40b-05e5-549a-9854-2629ad765fd1 with identifier: 1988812
2026-03-27 16:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 46cbf40b-05e5-549a-9854-2629ad765fd1 with identifier: 1988812 to the API
2026-03-27 16:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO FROZEN PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '46cbf40b-05e5-549a-9854-2629ad765fd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 ECOBLUE 120CV 2WD TITANIUM BUS. AUTO FP',
'odometer': 139421,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493585,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521170,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577904,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577904,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448899,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cbf40b-05e5-549a-9854-2629ad765fd1/46cbf40b-05e5-549a-9854-2629ad765fd1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/76ac775b34364722bc4a89d233d1e621/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 ECOBLUE 120CV 2WD TITANIUM BUS. AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988812%27 HTTP/1.1" 200 None
2026-03-27 16:30:37 [ayvens.it] INFO: Saving data for 1988812: {'created_time': 1774629037.209239, 'last_price_update_time': 1774629037.20925, 'auction_closing_time': 1774944000.0}
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988812') HTTP/1.1" 204 0
2026-03-27 16:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/8.jpg not downloaded yet
2026-03-27 16:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b33390>
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/2.jpg saved to cache
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/9.jpg not downloaded yet
2026-03-27 16:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/10.jpg not downloaded yet
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5dad0>
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/1.jpg saved to cache
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af7cd0>
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/3.jpg saved to cache
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d03f50>
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/4.jpg saved to cache
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:37 [ayvens.it] INFO: Found listing with ID: 1988815
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988815%27 HTTP/1.1" 200 None
2026-03-27 16:30:37 [ayvens.it] INFO: Scrape type for 1988815: 1
2026-03-27 16:30:37 [ayvens.it] INFO: Extracting data for car ID: 1988815
2026-03-27 16:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc28dec-02e7-553f-ba95-a352fbce1dbe with identifier: 1988815
2026-03-27 16:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe with scrape type 1
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/1.jpg not downloaded yet
2026-03-27 16:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/2.jpg not downloaded yet
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68546d50>
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/5.jpg saved to cache
2026-03-27 16:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5d490>
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/5.jpg saved to cache
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d36590>
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/6.jpg saved to cache
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/3.jpg not downloaded yet
2026-03-27 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/4.jpg not downloaded yet
2026-03-27 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/5.jpg not downloaded yet
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c52d0>
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/7.jpg saved to cache
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/6.jpg not downloaded yet
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/7.jpg not downloaded yet
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18290>
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/4.jpg saved to cache
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0e390>
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/9.jpg saved to cache
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca2810>
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/8.jpg saved to cache
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0cfd0>
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9aaae611c96142559832ddfe73795f54%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/10.jpg saved to cache
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 107fcdee-cdc7-5ebf-9f87-73779d89e868
2026-03-27 16:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 107fcdee-cdc7-5ebf-9f87-73779d89e868, skipping ID generation
2026-03-27 16:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107fcdee-cdc7-5ebf-9f87-73779d89e868 with scrape type 1
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 107fcdee-cdc7-5ebf-9f87-73779d89e868 sending to next pipeline
2026-03-27 16:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 107fcdee-cdc7-5ebf-9f87-73779d89e868, identifier: 1988813
2026-03-27 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/8.jpg not downloaded yet
2026-03-27 16:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 107fcdee-cdc7-5ebf-9f87-73779d89e868 with identifier: 1988813
2026-03-27 16:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 107fcdee-cdc7-5ebf-9f87-73779d89e868 with identifier: 1988813
2026-03-27 16:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 107fcdee-cdc7-5ebf-9f87-73779d89e868 with identifier: 1988813 to the API
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PEARL BLACK MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '107fcdee-cdc7-5ebf-9f87-73779d89e868',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 AIRCROSS PURETECH 110 S&S SHINE FP',
'odometer': 65380,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 740254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107fcdee-cdc7-5ebf-9f87-73779d89e868/107fcdee-cdc7-5ebf-9f87-73779d89e868_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594885,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9aaae611c96142559832ddfe73795f54/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-06',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 AIRCROSS PURETECH 110 S&S SHINE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988813%27 HTTP/1.1" 200 None
2026-03-27 16:30:39 [ayvens.it] INFO: Saving data for 1988813: {'created_time': 1774629039.296776, 'last_price_update_time': 1774629039.296792, 'auction_closing_time': 1774944000.0}
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988813') HTTP/1.1" 204 0
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/9.jpg not downloaded yet
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/10.jpg not downloaded yet
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aced90>
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/1.jpg saved to cache
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c23e10>
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/3.jpg saved to cache
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb5a90>
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/2.jpg saved to cache
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c20390>
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/4.jpg saved to cache
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:39 [ayvens.it] INFO: Found listing with ID: 1988816
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988816%27 HTTP/1.1" 200 None
2026-03-27 16:30:39 [ayvens.it] INFO: Scrape type for 1988816: 1
2026-03-27 16:30:39 [ayvens.it] INFO: Extracting data for car ID: 1988816
2026-03-27 16:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a61e44-90fd-5461-8c2b-3c941d13c5ca with identifier: 1988816
2026-03-27 16:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca with scrape type 1
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/1.jpg not downloaded yet
2026-03-27 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/2.jpg not downloaded yet
2026-03-27 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/3.jpg not downloaded yet
2026-03-27 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/4.jpg not downloaded yet
2026-03-27 16:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/5.jpg not downloaded yet
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f58d0>
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/6.jpg saved to cache
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/6.jpg not downloaded yet
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/7.jpg not downloaded yet
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5ed10>
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/5.jpg saved to cache
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928cc90>
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/7.jpg saved to cache
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928d810>
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/8.jpg saved to cache
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fadc50>
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/9.jpg saved to cache
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692342d0>
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/3.jpg saved to cache
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928df10>
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/2.jpg saved to cache
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68608510>
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252F0a1c21909a714a3f8a1598ce0d4869a7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/10.jpg saved to cache
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c77e5459-e2b5-538c-871b-23b89632c540
2026-03-27 16:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c77e5459-e2b5-538c-871b-23b89632c540, skipping ID generation
2026-03-27 16:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c77e5459-e2b5-538c-871b-23b89632c540 with scrape type 1
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c77e5459-e2b5-538c-871b-23b89632c540 sending to next pipeline
2026-03-27 16:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c77e5459-e2b5-538c-871b-23b89632c540, identifier: 1988814
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/8.jpg not downloaded yet
2026-03-27 16:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c77e5459-e2b5-538c-871b-23b89632c540 with identifier: 1988814
2026-03-27 16:30:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c77e5459-e2b5-538c-871b-23b89632c540 with identifier: 1988814
2026-03-27 16:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c77e5459-e2b5-538c-871b-23b89632c540 with identifier: 1988814 to the API
2026-03-27 16:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'EIGER GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'c77e5459-e2b5-538c-871b-23b89632c540',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv SE 4WD aut. Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 76554,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 787449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598169,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529620,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c77e5459-e2b5-538c-871b-23b89632c540/c77e5459-e2b5-538c-871b-23b89632c540_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/0a1c21909a714a3f8a1598ce0d4869a7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv SE 4WD aut. '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988814%27 HTTP/1.1" 200 None
2026-03-27 16:30:45 [ayvens.it] INFO: Saving data for 1988814: {'created_time': 1774629045.849402, 'last_price_update_time': 1774629045.849417, 'auction_closing_time': 1774944000.0}
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988814') HTTP/1.1" 204 0
2026-03-27 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/9.jpg not downloaded yet
2026-03-27 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/10.jpg not downloaded yet
2026-03-27 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:45 [ayvens.it] INFO: Found listing with ID: 1988817
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988817%27 HTTP/1.1" 200 None
2026-03-27 16:30:45 [ayvens.it] INFO: Scrape type for 1988817: 1
2026-03-27 16:30:45 [ayvens.it] INFO: Extracting data for car ID: 1988817
2026-03-27 16:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe with identifier: 1988817
2026-03-27 16:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe with scrape type 1
2026-03-27 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/1.jpg not downloaded yet
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/2.jpg not downloaded yet
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/3.jpg not downloaded yet
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecf050>
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/3.jpg saved to cache
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/4.jpg not downloaded yet
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecc350>
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/4.jpg saved to cache
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/5.jpg not downloaded yet
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6c49e1d0>
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/5.jpg saved to cache
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68609b50>
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F98d9a70c8bff47d18a4f748af6303586%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/1.jpg saved to cache
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c177257-1c73-51bb-b806-938c6ae3fc43
2026-03-27 16:30:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c177257-1c73-51bb-b806-938c6ae3fc43, skipping ID generation
2026-03-27 16:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c177257-1c73-51bb-b806-938c6ae3fc43 with scrape type 1
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c177257-1c73-51bb-b806-938c6ae3fc43 sending to next pipeline
2026-03-27 16:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5c177257-1c73-51bb-b806-938c6ae3fc43, identifier: 1988810
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad09450>
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/7.jpg saved to cache
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c48690>
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/2.jpg saved to cache
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feea90>
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/1.jpg saved to cache
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a69f10>
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/6.jpg saved to cache
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/6.jpg not downloaded yet
2026-03-27 16:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5c177257-1c73-51bb-b806-938c6ae3fc43 with identifier: 1988810
2026-03-27 16:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5c177257-1c73-51bb-b806-938c6ae3fc43 with identifier: 1988810
2026-03-27 16:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5c177257-1c73-51bb-b806-938c6ae3fc43 with identifier: 1988810 to the API
2026-03-27 16:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '5c177257-1c73-51bb-b806-938c6ae3fc43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 123905,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 42,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538188,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c177257-1c73-51bb-b806-938c6ae3fc43/5c177257-1c73-51bb-b806-938c6ae3fc43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381170,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/98d9a70c8bff47d18a4f748af6303586/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988810%27 HTTP/1.1" 200 None
2026-03-27 16:30:53 [ayvens.it] INFO: Saving data for 1988810: {'created_time': 1774629053.741396, 'last_price_update_time': 1774629053.741407, 'auction_closing_time': 1774944000.0}
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988810') HTTP/1.1" 204 0
2026-03-27 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/7.jpg not downloaded yet
2026-03-27 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/8.jpg not downloaded yet
2026-03-27 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/9.jpg not downloaded yet
2026-03-27 16:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/10.jpg not downloaded yet
2026-03-27 16:30:53 [ayvens.it] INFO: Found listing with ID: 1988818
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988818%27 HTTP/1.1" 200 None
2026-03-27 16:30:53 [ayvens.it] INFO: Scrape type for 1988818: 1
2026-03-27 16:30:53 [ayvens.it] INFO: Extracting data for car ID: 1988818
2026-03-27 16:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ed787f-da16-599c-8604-0139b22e911f with identifier: 1988818
2026-03-27 16:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ed787f-da16-599c-8604-0139b22e911f with scrape type 1
2026-03-27 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/1.jpg not downloaded yet
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/2.jpg not downloaded yet
2026-03-27 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af4a50>
2026-03-27 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/8.jpg saved to cache
2026-03-27 16:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68608890>
2026-03-27 16:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/2.jpg saved to cache
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb5e90>
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/10.jpg saved to cache
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb6350>
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/3.jpg saved to cache
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/3.jpg not downloaded yet
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b6c6210>
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/10.jpg saved to cache
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd2790>
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk3%252F2b6c5092ebcf45ca955f9bb915afe061%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/9.jpg saved to cache
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe
2026-03-27 16:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fc28dec-02e7-553f-ba95-a352fbce1dbe, skipping ID generation
2026-03-27 16:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe with scrape type 1
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fc28dec-02e7-553f-ba95-a352fbce1dbe sending to next pipeline
2026-03-27 16:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9fc28dec-02e7-553f-ba95-a352fbce1dbe, identifier: 1988815
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c34d10>
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/4.jpg saved to cache
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/4.jpg not downloaded yet
2026-03-27 16:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9fc28dec-02e7-553f-ba95-a352fbce1dbe with identifier: 1988815
2026-03-27 16:30:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9fc28dec-02e7-553f-ba95-a352fbce1dbe with identifier: 1988815
2026-03-27 16:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9fc28dec-02e7-553f-ba95-a352fbce1dbe with identifier: 1988815 to the API
2026-03-27 16:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'LUCID RED METALLIZZATO PREMIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '9fc28dec-02e7-553f-ba95-a352fbce1dbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE AUT FP',
'odometer': 106898,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 610630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383256,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540615,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393717,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631241,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc28dec-02e7-553f-ba95-a352fbce1dbe/9fc28dec-02e7-553f-ba95-a352fbce1dbe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk3/2b6c5092ebcf45ca955f9bb915afe061/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE AUT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988815%27 HTTP/1.1" 200 None
2026-03-27 16:31:03 [ayvens.it] INFO: Saving data for 1988815: {'created_time': 1774629063.553277, 'last_price_update_time': 1774629063.553288, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988815') HTTP/1.1" 204 0
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/5.jpg not downloaded yet
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b844690>
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/1.jpg saved to cache
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/6.jpg not downloaded yet
2026-03-27 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/7.jpg not downloaded yet
2026-03-27 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/8.jpg not downloaded yet
2026-03-27 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/9.jpg not downloaded yet
2026-03-27 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/10.jpg not downloaded yet
2026-03-27 16:31:04 [ayvens.it] INFO: Found listing with ID: 1988819
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988819%27 HTTP/1.1" 200 None
2026-03-27 16:31:04 [ayvens.it] INFO: Scrape type for 1988819: 1
2026-03-27 16:31:04 [ayvens.it] INFO: Extracting data for car ID: 1988819
2026-03-27 16:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d75d8e3-333e-533f-ab62-22a1c8bc1b65 with identifier: 1988819
2026-03-27 16:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65 with scrape type 1
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/1.jpg not downloaded yet
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/2.jpg not downloaded yet
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c35e10>
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/7.jpg saved to cache
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5ec50>
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/9.jpg saved to cache
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b56710>
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/5.jpg saved to cache
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69072750>
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/8.jpg saved to cache
2026-03-27 16:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68541090>
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/9.jpg saved to cache
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68515690>
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/8.jpg saved to cache
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/3.jpg not downloaded yet
2026-03-27 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68607590>
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/6.jpg saved to cache
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cfabd0>
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Fdbfcf0ad7d93409ba9d3a12ef75dbffb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/10.jpg saved to cache
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca
2026-03-27 16:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0a61e44-90fd-5461-8c2b-3c941d13c5ca, skipping ID generation
2026-03-27 16:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca with scrape type 1
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0a61e44-90fd-5461-8c2b-3c941d13c5ca sending to next pipeline
2026-03-27 16:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a0a61e44-90fd-5461-8c2b-3c941d13c5ca, identifier: 1988816
2026-03-27 16:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/4.jpg not downloaded yet
2026-03-27 16:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a0a61e44-90fd-5461-8c2b-3c941d13c5ca with identifier: 1988816
2026-03-27 16:31:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a0a61e44-90fd-5461-8c2b-3c941d13c5ca with identifier: 1988816
2026-03-27 16:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a0a61e44-90fd-5461-8c2b-3c941d13c5ca with identifier: 1988816 to the API
2026-03-27 16:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Agate Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'a0a61e44-90fd-5461-8c2b-3c941d13c5ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv Business SW SW 5-door (Euro 6.2)',
'odometer': 241937,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 798095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496460,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 833839,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a61e44-90fd-5461-8c2b-3c941d13c5ca/a0a61e44-90fd-5461-8c2b-3c941d13c5ca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 801383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/dbfcf0ad7d93409ba9d3a12ef75dbffb/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv Business SW SW 5-door (Euro 6.2) '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988816%27 HTTP/1.1" 200 None
2026-03-27 16:31:06 [ayvens.it] INFO: Saving data for 1988816: {'created_time': 1774629066.291303, 'last_price_update_time': 1774629066.291315, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988816') HTTP/1.1" 204 0
2026-03-27 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 6 pages/min), scraped 8 items (at 8 items/min)
2026-03-27 16:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/5.jpg not downloaded yet
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c86b50>
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/7.jpg saved to cache
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecc3d0>
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/4.jpg saved to cache
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/6.jpg not downloaded yet
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cde350>
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/8.jpg saved to cache
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/7.jpg not downloaded yet
2026-03-27 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdde90>
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/3.jpg saved to cache
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d82d0>
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/6.jpg saved to cache
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c48790>
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/2.jpg saved to cache
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d9350>
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/3.jpg saved to cache
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/8.jpg not downloaded yet
2026-03-27 16:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/9.jpg not downloaded yet
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c5090>
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/5.jpg saved to cache
2026-03-27 16:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6921cb90>
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/5.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/10.jpg not downloaded yet
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [ayvens.it] INFO: Found listing with ID: 1988820
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988820%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [ayvens.it] INFO: Scrape type for 1988820: 1
2026-03-27 16:31:07 [ayvens.it] INFO: Extracting data for car ID: 1988820
2026-03-27 16:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48b2e797-60a5-5876-b477-008053a12746 with identifier: 1988820
2026-03-27 16:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b2e797-60a5-5876-b477-008053a12746 with scrape type 1
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/1.jpg not downloaded yet
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6921db50>
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/4.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/2.jpg not downloaded yet
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/3.jpg not downloaded yet
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/4.jpg not downloaded yet
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1c850>
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/2.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b83710>
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/6.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b8a090>
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/2.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68521250>
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/3.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcd8d0>
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/7.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/5.jpg not downloaded yet
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/6.jpg not downloaded yet
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69045650>
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/1.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ade450>
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/5.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6850a0d0>
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/1.jpg saved to cache
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/7.jpg not downloaded yet
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/8.jpg not downloaded yet
2026-03-27 16:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/9.jpg not downloaded yet
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68adcb50>
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/4.jpg saved to cache
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/10.jpg not downloaded yet
2026-03-27 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:08 [ayvens.it] INFO: Found listing with ID: 1988821
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988821%27 HTTP/1.1" 200 None
2026-03-27 16:31:08 [ayvens.it] INFO: Scrape type for 1988821: 1
2026-03-27 16:31:08 [ayvens.it] INFO: Extracting data for car ID: 1988821
2026-03-27 16:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa88892-7deb-55e4-92f9-b6dbb4093dad with identifier: 1988821
2026-03-27 16:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad with scrape type 1
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/1.jpg not downloaded yet
2026-03-27 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922da10>
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/10.jpg saved to cache
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f15d0>
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/10.jpg saved to cache
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b702d0>
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/8.jpg saved to cache
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/2.jpg not downloaded yet
2026-03-27 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/3.jpg not downloaded yet
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/4.jpg not downloaded yet
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69091810>
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252F1b9ae28516244af99a1adf9c0117eda8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/9.jpg saved to cache
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00ed787f-da16-599c-8604-0139b22e911f
2026-03-27 16:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00ed787f-da16-599c-8604-0139b22e911f, skipping ID generation
2026-03-27 16:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ed787f-da16-599c-8604-0139b22e911f with scrape type 1
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00ed787f-da16-599c-8604-0139b22e911f sending to next pipeline
2026-03-27 16:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 00ed787f-da16-599c-8604-0139b22e911f, identifier: 1988818
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f98d0>
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/6.jpg saved to cache
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b67d0>
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/9.jpg saved to cache
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b20b10>
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/9.jpg saved to cache
2026-03-27 16:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 00ed787f-da16-599c-8604-0139b22e911f with identifier: 1988818
2026-03-27 16:31:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 00ed787f-da16-599c-8604-0139b22e911f with identifier: 1988818
2026-03-27 16:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 00ed787f-da16-599c-8604-0139b22e911f with identifier: 1988818 to the API
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Solar Silver metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '00ed787f-da16-599c-8604-0139b22e911f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 EcoBlue 120CV 2WD Titanium Bus. Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 155330,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484389,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489081,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed787f-da16-599c-8604-0139b22e911f/00ed787f-da16-599c-8604-0139b22e911f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/1b9ae28516244af99a1adf9c0117eda8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 EcoBlue 120CV 2WD Titanium Bus. Auto Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988818%27 HTTP/1.1" 200 None
2026-03-27 16:31:09 [ayvens.it] INFO: Saving data for 1988818: {'created_time': 1774629069.35245, 'last_price_update_time': 1774629069.352461, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988818') HTTP/1.1" 204 0
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/5.jpg not downloaded yet
2026-03-27 16:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/6.jpg not downloaded yet
2026-03-27 16:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfee90>
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/8.jpg saved to cache
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68954910>
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/7.jpg saved to cache
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853e690>
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw9%252F1548d83ac75547f48c5b4bedbdf2d58e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/1.jpg saved to cache
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe
2026-03-27 16:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe, skipping ID generation
2026-03-27 16:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe with scrape type 1
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe sending to next pipeline
2026-03-27 16:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe, identifier: 1988817
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/7.jpg not downloaded yet
2026-03-27 16:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe with identifier: 1988817
2026-03-27 16:31:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe with identifier: 1988817
2026-03-27 16:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe with identifier: 1988817 to the API
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CARBON BLACK METALLIZZATA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X3 XDRIVE 20D MH48V MSPORT',
'odometer': 13252,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 617301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245139,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592998,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303230,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454249,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe/9ab81c66-5ef0-5b4b-9a77-7f650d6ca2fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw9/1548d83ac75547f48c5b4bedbdf2d58e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-10-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X3 XDRIVE 20D MH48V MSPORT -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988817%27 HTTP/1.1" 200 None
2026-03-27 16:31:10 [ayvens.it] INFO: Saving data for 1988817: {'created_time': 1774629070.147757, 'last_price_update_time': 1774629070.147768, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988817') HTTP/1.1" 204 0
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/8.jpg not downloaded yet
2026-03-27 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922fd50>
2026-03-27 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F458f7277b01945838be62164e06af462%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/7.jpg saved to cache
2026-03-27 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9
2026-03-27 16:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9, skipping ID generation
2026-03-27 16:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with scrape type 1
2026-03-27 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 sending to next pipeline
2026-03-27 16:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9, identifier: 1988809
2026-03-27 16:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c86550>
2026-03-27 16:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw8%252F92be96f8c71f4b4699480e37ab1a2e16%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/10.jpg saved to cache
2026-03-27 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65
2026-03-27 16:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d75d8e3-333e-533f-ab62-22a1c8bc1b65, skipping ID generation
2026-03-27 16:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65 with scrape type 1
2026-03-27 16:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d75d8e3-333e-533f-ab62-22a1c8bc1b65 sending to next pipeline
2026-03-27 16:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7d75d8e3-333e-533f-ab62-22a1c8bc1b65, identifier: 1988819
2026-03-27 16:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with identifier: 1988809
2026-03-27 16:31:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with identifier: 1988809
2026-03-27 16:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9 with identifier: 1988809 to the API
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN',
'odometer': 157498,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589815,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496221,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9/7fc249fe-1aeb-5c94-b3e7-86d3135bdbd9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/458f7277b01945838be62164e06af462/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988809%27 HTTP/1.1" 200 None
2026-03-27 16:31:10 [ayvens.it] INFO: Saving data for 1988809: {'created_time': 1774629070.872821, 'last_price_update_time': 1774629070.872831, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988809') HTTP/1.1" 204 0
2026-03-27 16:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7d75d8e3-333e-533f-ab62-22a1c8bc1b65 with identifier: 1988819
2026-03-27 16:31:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7d75d8e3-333e-533f-ab62-22a1c8bc1b65 with identifier: 1988819
2026-03-27 16:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7d75d8e3-333e-533f-ab62-22a1c8bc1b65 with identifier: 1988819 to the API
2026-03-27 16:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'INDUS SILVER METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '7d75d8e3-333e-533f-ab62-22a1c8bc1b65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER SPORT 3.0 SDV6 249cv HSE Dynamic aut. Sport '
'utility vehicle 5-door (Euro 6.2)',
'odometer': 79971,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253518,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322404,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335821,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608921,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d75d8e3-333e-533f-ab62-22a1c8bc1b65/7d75d8e3-333e-533f-ab62-22a1c8bc1b65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw8/92be96f8c71f4b4699480e37ab1a2e16/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER SPORT 3.0 SDV6 249cv HSE Dynamic '
'aut. Sport utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988819%27 HTTP/1.1" 200 None
2026-03-27 16:31:11 [ayvens.it] INFO: Saving data for 1988819: {'created_time': 1774629071.349033, 'last_price_update_time': 1774629071.349044, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988819') HTTP/1.1" 204 0
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/9.jpg not downloaded yet
2026-03-27 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/10.jpg not downloaded yet
2026-03-27 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:11 [ayvens.it] INFO: Found listing with ID: 1988822
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988822%27 HTTP/1.1" 200 None
2026-03-27 16:31:11 [ayvens.it] INFO: Scrape type for 1988822: 1
2026-03-27 16:31:11 [ayvens.it] INFO: Extracting data for car ID: 1988822
2026-03-27 16:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efee0cd4-f8fe-5d68-ad33-24f2e59bebf4 with identifier: 1988822
2026-03-27 16:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4 with scrape type 1
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/1.jpg not downloaded yet
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/2.jpg not downloaded yet
2026-03-27 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/3.jpg not downloaded yet
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835c550>
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/6.jpg saved to cache
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c13250>
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/3.jpg saved to cache
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2efd0>
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/1.jpg saved to cache
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/4.jpg not downloaded yet
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/5.jpg not downloaded yet
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e698e8b50>
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/5.jpg saved to cache
2026-03-27 16:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c4a50>
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/2.jpg saved to cache
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd2050>
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/7.jpg saved to cache
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4b8d0>
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/4.jpg saved to cache
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c86110>
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/9.jpg saved to cache
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/6.jpg not downloaded yet
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/7.jpg not downloaded yet
2026-03-27 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/8.jpg not downloaded yet
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/9.jpg not downloaded yet
2026-03-27 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/10.jpg not downloaded yet
2026-03-27 16:31:12 [ayvens.it] INFO: Found listing with ID: 1988823
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988823%27 HTTP/1.1" 200 None
2026-03-27 16:31:12 [ayvens.it] INFO: Scrape type for 1988823: 1
2026-03-27 16:31:12 [ayvens.it] INFO: Extracting data for car ID: 1988823
2026-03-27 16:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b28a12-1217-556c-8520-389058f5e913 with identifier: 1988823
2026-03-27 16:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b28a12-1217-556c-8520-389058f5e913 with scrape type 1
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/1.jpg not downloaded yet
2026-03-27 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/2.jpg not downloaded yet
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c229d0>
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/8.jpg saved to cache
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2e50>
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fcbfcf7155b5a460f821f1e0649ba29a9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/10.jpg saved to cache
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48b2e797-60a5-5876-b477-008053a12746
2026-03-27 16:31:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48b2e797-60a5-5876-b477-008053a12746, skipping ID generation
2026-03-27 16:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b2e797-60a5-5876-b477-008053a12746 with scrape type 1
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48b2e797-60a5-5876-b477-008053a12746 sending to next pipeline
2026-03-27 16:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 48b2e797-60a5-5876-b477-008053a12746, identifier: 1988820
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/3.jpg not downloaded yet
2026-03-27 16:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 48b2e797-60a5-5876-b477-008053a12746 with identifier: 1988820
2026-03-27 16:31:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 48b2e797-60a5-5876-b477-008053a12746 with identifier: 1988820
2026-03-27 16:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 48b2e797-60a5-5876-b477-008053a12746 with identifier: 1988820 to the API
2026-03-27 16:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Pure White pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '48b2e797-60a5-5876-b477-008053a12746',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI SCR Elegance DSG 4MOTION Sport '
'utility vehicle 5-door (Euro 6D)',
'odometer': 108670,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 42,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 734972,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 736526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 729860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2e797-60a5-5876-b477-008053a12746/48b2e797-60a5-5876-b477-008053a12746_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/cbfcf7155b5a460f821f1e0649ba29a9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI SCR Elegance DSG '
'4MOTION Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988820%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [ayvens.it] INFO: Saving data for 1988820: {'created_time': 1774629074.150402, 'last_price_update_time': 1774629074.150412, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988820') HTTP/1.1" 204 0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/4.jpg not downloaded yet
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/5.jpg not downloaded yet
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa258d0>
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/2.jpg saved to cache
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb7350>
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/3.jpg saved to cache
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d005d0>
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/1.jpg saved to cache
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6902a690>
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/4.jpg saved to cache
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b55950>
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/6.jpg saved to cache
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c56bd0>
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/5.jpg saved to cache
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/6.jpg not downloaded yet
2026-03-27 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/7.jpg not downloaded yet
2026-03-27 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/8.jpg not downloaded yet
2026-03-27 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/9.jpg not downloaded yet
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/10.jpg not downloaded yet
2026-03-27 16:31:14 [ayvens.it] INFO: Found listing with ID: 1988824
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988824%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [ayvens.it] INFO: Scrape type for 1988824: 1
2026-03-27 16:31:14 [ayvens.it] INFO: Extracting data for car ID: 1988824
2026-03-27 16:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f73dd6f7-0c1d-5865-aadf-14399c0c23a0 with identifier: 1988824
2026-03-27 16:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0 with scrape type 1
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/1.jpg not downloaded yet
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/2.jpg not downloaded yet
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f05310>
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/4.jpg saved to cache
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/3.jpg not downloaded yet
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f06550>
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/7.jpg saved to cache
2026-03-27 16:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fef250>
2026-03-27 16:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/1.jpg saved to cache
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca2d90>
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/8.jpg saved to cache
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc7490>
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/3.jpg saved to cache
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68611490>
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/2.jpg saved to cache
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/4.jpg not downloaded yet
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/5.jpg not downloaded yet
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685220d0>
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/10.jpg saved to cache
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccd550>
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fdec1626e51064a938fde33efe534c025%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/9.jpg saved to cache
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad
2026-03-27 16:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fa88892-7deb-55e4-92f9-b6dbb4093dad, skipping ID generation
2026-03-27 16:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad with scrape type 1
2026-03-27 16:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fa88892-7deb-55e4-92f9-b6dbb4093dad sending to next pipeline
2026-03-27 16:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8fa88892-7deb-55e4-92f9-b6dbb4093dad, identifier: 1988821
2026-03-27 16:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8fa88892-7deb-55e4-92f9-b6dbb4093dad with identifier: 1988821
2026-03-27 16:31:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8fa88892-7deb-55e4-92f9-b6dbb4093dad with identifier: 1988821
2026-03-27 16:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8fa88892-7deb-55e4-92f9-b6dbb4093dad with identifier: 1988821 to the API
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '8fa88892-7deb-55e4-92f9-b6dbb4093dad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 B4 D AUTOMATICO PLUS DARK',
'odometer': 144446,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 67,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 835111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 835111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 825331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794725,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 771105,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588316,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa88892-7deb-55e4-92f9-b6dbb4093dad/8fa88892-7deb-55e4-92f9-b6dbb4093dad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/dec1626e51064a938fde33efe534c025/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 B4 D AUTOMATICO PLUS DARK -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988821%27 HTTP/1.1" 200 None
2026-03-27 16:31:16 [ayvens.it] INFO: Saving data for 1988821: {'created_time': 1774629076.114594, 'last_price_update_time': 1774629076.114605, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988821') HTTP/1.1" 204 0
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/6.jpg not downloaded yet
2026-03-27 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/7.jpg not downloaded yet
2026-03-27 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/8.jpg not downloaded yet
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/9.jpg not downloaded yet
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/10.jpg not downloaded yet
2026-03-27 16:31:16 [ayvens.it] INFO: Found listing with ID: 1988825
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988825%27 HTTP/1.1" 200 None
2026-03-27 16:31:16 [ayvens.it] INFO: Scrape type for 1988825: 1
2026-03-27 16:31:16 [ayvens.it] INFO: Extracting data for car ID: 1988825
2026-03-27 16:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8876e677-25f4-5cdb-a183-d555b601b569 with identifier: 1988825
2026-03-27 16:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8876e677-25f4-5cdb-a183-d555b601b569 with scrape type 1
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/1.jpg not downloaded yet
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/2.jpg not downloaded yet
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b89390>
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/5.jpg saved to cache
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fe8290>
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/6.jpg saved to cache
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc8690>
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/4.jpg saved to cache
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928cd50>
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/8.jpg saved to cache
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feb050>
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/7.jpg saved to cache
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b81cd0>
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/9.jpg saved to cache
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feac90>
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/5.jpg saved to cache
2026-03-27 16:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916f150>
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/6.jpg saved to cache
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/3.jpg not downloaded yet
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/4.jpg not downloaded yet
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/5.jpg not downloaded yet
2026-03-27 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/6.jpg not downloaded yet
2026-03-27 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/7.jpg not downloaded yet
2026-03-27 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/8.jpg not downloaded yet
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/9.jpg not downloaded yet
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/10.jpg not downloaded yet
2026-03-27 16:31:17 [ayvens.it] INFO: Found listing with ID: 1988826
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988826%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [ayvens.it] INFO: Scrape type for 1988826: 1
2026-03-27 16:31:17 [ayvens.it] INFO: Extracting data for car ID: 1988826
2026-03-27 16:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bcef69-d6fc-5feb-834f-6c524a3aec7b with identifier: 1988826
2026-03-27 16:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b with scrape type 1
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/1.jpg not downloaded yet
2026-03-27 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b7a10>
2026-03-27 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/7.jpg saved to cache
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e6050>
2026-03-27 16:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F5712ad3d92e94fc38d800d5734b24530%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/10.jpg saved to cache
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4
2026-03-27 16:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efee0cd4-f8fe-5d68-ad33-24f2e59bebf4, skipping ID generation
2026-03-27 16:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4 with scrape type 1
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efee0cd4-f8fe-5d68-ad33-24f2e59bebf4 sending to next pipeline
2026-03-27 16:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: efee0cd4-f8fe-5d68-ad33-24f2e59bebf4, identifier: 1988822
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/2.jpg not downloaded yet
2026-03-27 16:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: efee0cd4-f8fe-5d68-ad33-24f2e59bebf4 with identifier: 1988822
2026-03-27 16:31:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: efee0cd4-f8fe-5d68-ad33-24f2e59bebf4 with identifier: 1988822
2026-03-27 16:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: efee0cd4-f8fe-5d68-ad33-24f2e59bebf4 with identifier: 1988822 to the API
2026-03-27 16:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO VESUVIO METALLIZZATO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'efee0cd4-f8fe-5d68-ad33-24f2e59bebf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 (PC) 1.0 70CV IBRIDO CLUB FP',
'odometer': 18067,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579954,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598729,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efee0cd4-f8fe-5d68-ad33-24f2e59bebf4/efee0cd4-f8fe-5d68-ad33-24f2e59bebf4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/5712ad3d92e94fc38d800d5734b24530/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 (PC) 1.0 70CV IBRIDO CLUB FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988822%27 HTTP/1.1" 200 None
2026-03-27 16:31:18 [ayvens.it] INFO: Saving data for 1988822: {'created_time': 1774629078.946155, 'last_price_update_time': 1774629078.946165, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988822') HTTP/1.1" 204 0
2026-03-27 16:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68520ed0>
2026-03-27 16:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/3.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d37ad0>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/3.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928da90>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/2.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69018c90>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/1.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69514110>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/1.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bedc10>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/2.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/3.jpg not downloaded yet
2026-03-27 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/4.jpg not downloaded yet
2026-03-27 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/5.jpg not downloaded yet
2026-03-27 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/6.jpg not downloaded yet
2026-03-27 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/7.jpg not downloaded yet
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/8.jpg not downloaded yet
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/9.jpg not downloaded yet
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a6ba90>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/10.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/10.jpg not downloaded yet
2026-03-27 16:31:19 [ayvens.it] INFO: Found listing with ID: 1988827
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988827%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [ayvens.it] INFO: Scrape type for 1988827: 1
2026-03-27 16:31:19 [ayvens.it] INFO: Extracting data for car ID: 1988827
2026-03-27 16:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72cb8055-e0c2-526a-b031-10be636e8c29 with identifier: 1988827
2026-03-27 16:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72cb8055-e0c2-526a-b031-10be636e8c29 with scrape type 1
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/1.jpg not downloaded yet
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/2.jpg not downloaded yet
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fec190>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/6.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a68210>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/5.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d21510>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/4.jpg saved to cache
2026-03-27 16:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ae24290>
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/9.jpg saved to cache
2026-03-27 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5b690>
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/8.jpg saved to cache
2026-03-27 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923fd50>
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/7.jpg saved to cache
2026-03-27 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d45f90>
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2ca05d54f367419cafa1750bffbedafe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/8.jpg saved to cache
2026-03-27 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2b28a12-1217-556c-8520-389058f5e913
2026-03-27 16:31:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2b28a12-1217-556c-8520-389058f5e913, skipping ID generation
2026-03-27 16:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b28a12-1217-556c-8520-389058f5e913 with scrape type 1
2026-03-27 16:31:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2b28a12-1217-556c-8520-389058f5e913 sending to next pipeline
2026-03-27 16:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f2b28a12-1217-556c-8520-389058f5e913, identifier: 1988823
2026-03-27 16:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f2b28a12-1217-556c-8520-389058f5e913 with identifier: 1988823
2026-03-27 16:31:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f2b28a12-1217-556c-8520-389058f5e913 with identifier: 1988823
2026-03-27 16:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f2b28a12-1217-556c-8520-389058f5e913 with identifier: 1988823 to the API
2026-03-27 16:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ALPINE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'f2b28a12-1217-556c-8520-389058f5e913',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 SDRIVE 18D X-LINE EDITION BALANCE DCT FP',
'odometer': 167592,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562623,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 685901,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b28a12-1217-556c-8520-389058f5e913/f2b28a12-1217-556c-8520-389058f5e913_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2ca05d54f367419cafa1750bffbedafe/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 SDRIVE 18D X-LINE EDITION BALANCE DCT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988823%27 HTTP/1.1" 200 None
2026-03-27 16:31:26 [ayvens.it] INFO: Saving data for 1988823: {'created_time': 1774629086.613687, 'last_price_update_time': 1774629086.613703, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988823') HTTP/1.1" 204 0
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/3.jpg not downloaded yet
2026-03-27 16:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/4.jpg not downloaded yet
2026-03-27 16:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/5.jpg not downloaded yet
2026-03-27 16:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/6.jpg not downloaded yet
2026-03-27 16:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/7.jpg not downloaded yet
2026-03-27 16:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/8.jpg not downloaded yet
2026-03-27 16:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/9.jpg not downloaded yet
2026-03-27 16:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aeb6d0>
2026-03-27 16:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/10.jpg saved to cache
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/10.jpg not downloaded yet
2026-03-27 16:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b32990>
2026-03-27 16:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/2.jpg saved to cache
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:31:27 [ayvens.it] INFO: Found listing with ID: 1988828
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988828%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [ayvens.it] INFO: Scrape type for 1988828: 1
2026-03-27 16:31:27 [ayvens.it] INFO: Extracting data for car ID: 1988828
2026-03-27 16:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7235a9-b52f-5df2-b724-35ebe7dab0ac with identifier: 1988828
2026-03-27 16:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac with scrape type 1
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/1.jpg not downloaded yet
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/2.jpg not downloaded yet
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69516b50>
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/4.jpg saved to cache
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b6e50>
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/5.jpg saved to cache
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c59d0>
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/6.jpg saved to cache
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69234d10>
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/2.jpg saved to cache
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba3b90>
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/1.jpg saved to cache
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d03a10>
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/3.jpg saved to cache
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/3.jpg not downloaded yet
2026-03-27 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/4.jpg not downloaded yet
2026-03-27 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/5.jpg not downloaded yet
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/6.jpg not downloaded yet
2026-03-27 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/7.jpg not downloaded yet
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/8.jpg not downloaded yet
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/9.jpg not downloaded yet
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900a310>
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/4.jpg saved to cache
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c23950>
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/5.jpg saved to cache
2026-03-27 16:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcd850>
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/3.jpg saved to cache
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/10.jpg not downloaded yet
2026-03-27 16:31:28 [ayvens.it] INFO: Found listing with ID: 1988829
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988829%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [ayvens.it] INFO: Scrape type for 1988829: 1
2026-03-27 16:31:28 [ayvens.it] INFO: Extracting data for car ID: 1988829
2026-03-27 16:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aabde983-cd06-5582-9512-e57840d1001f with identifier: 1988829
2026-03-27 16:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aabde983-cd06-5582-9512-e57840d1001f with scrape type 1
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/1.jpg not downloaded yet
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/2.jpg not downloaded yet
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c21310>
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/10.jpg saved to cache
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916c4d0>
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/1.jpg saved to cache
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cce590>
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/8.jpg saved to cache
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6921f810>
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/9.jpg saved to cache
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c4e50>
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/10.jpg saved to cache
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/3.jpg not downloaded yet
2026-03-27 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/4.jpg not downloaded yet
2026-03-27 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/5.jpg not downloaded yet
2026-03-27 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/6.jpg not downloaded yet
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/7.jpg not downloaded yet
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/8.jpg not downloaded yet
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/9.jpg not downloaded yet
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bec210>
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/3.jpg saved to cache
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/10.jpg not downloaded yet
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bedf10>
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/5.jpg saved to cache
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694da3d0>
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/2.jpg saved to cache
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:28 [ayvens.it] INFO: Found listing with ID: 1988830
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988830%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [ayvens.it] INFO: Scrape type for 1988830: 1
2026-03-27 16:31:28 [ayvens.it] INFO: Extracting data for car ID: 1988830
2026-03-27 16:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53 with identifier: 1988830
2026-03-27 16:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53 with scrape type 1
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/1.jpg not downloaded yet
2026-03-27 16:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/2.jpg not downloaded yet
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fec650>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/6.jpg saved to cache
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68517c90>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/1.jpg saved to cache
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef63d0>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/3.jpg saved to cache
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68514ad0>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/4.jpg saved to cache
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bdb750>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/2.jpg saved to cache
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/3.jpg not downloaded yet
2026-03-27 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/4.jpg not downloaded yet
2026-03-27 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/5.jpg not downloaded yet
2026-03-27 16:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/6.jpg not downloaded yet
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/7.jpg not downloaded yet
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecd290>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/8.jpg saved to cache
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa23850>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/10.jpg saved to cache
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/8.jpg not downloaded yet
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835e350>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/9.jpg saved to cache
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8ccd0>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/10.jpg saved to cache
2026-03-27 16:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e4450>
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/5.jpg saved to cache
2026-03-27 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68533e10>
2026-03-27 16:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/4.jpg saved to cache
2026-03-27 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d10850>
2026-03-27 16:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F7a698ea5f4494e0b977f2a4c599cf147%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/7.jpg saved to cache
2026-03-27 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72cb8055-e0c2-526a-b031-10be636e8c29
2026-03-27 16:31:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72cb8055-e0c2-526a-b031-10be636e8c29, skipping ID generation
2026-03-27 16:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72cb8055-e0c2-526a-b031-10be636e8c29 with scrape type 1
2026-03-27 16:31:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72cb8055-e0c2-526a-b031-10be636e8c29 sending to next pipeline
2026-03-27 16:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 72cb8055-e0c2-526a-b031-10be636e8c29, identifier: 1988827
2026-03-27 16:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 72cb8055-e0c2-526a-b031-10be636e8c29 with identifier: 1988827
2026-03-27 16:31:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 72cb8055-e0c2-526a-b031-10be636e8c29 with identifier: 1988827
2026-03-27 16:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 72cb8055-e0c2-526a-b031-10be636e8c29 with identifier: 1988827 to the API
2026-03-27 16:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE CELEBES METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '72cb8055-e0c2-526a-b031-10be636e8c29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE FP',
'odometer': 82815,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 50,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678476,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587669,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678476,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 754502,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cb8055-e0c2-526a-b031-10be636e8c29/72cb8055-e0c2-526a-b031-10be636e8c29_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/7a698ea5f4494e0b977f2a4c599cf147/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988827%27 HTTP/1.1" 200 None
2026-03-27 16:31:38 [ayvens.it] INFO: Saving data for 1988827: {'created_time': 1774629098.732231, 'last_price_update_time': 1774629098.732242, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988827') HTTP/1.1" 204 0
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/9.jpg not downloaded yet
2026-03-27 16:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad100d0>
2026-03-27 16:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/1.jpg saved to cache
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/10.jpg not downloaded yet
2026-03-27 16:31:39 [ayvens.it] INFO: Found listing with ID: 1988831
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988831%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [ayvens.it] INFO: Scrape type for 1988831: 1
2026-03-27 16:31:39 [ayvens.it] INFO: Extracting data for car ID: 1988831
2026-03-27 16:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db0ae23-83f2-56ed-926c-c96feecde9d4 with identifier: 1988831
2026-03-27 16:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db0ae23-83f2-56ed-926c-c96feecde9d4 with scrape type 1
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/1.jpg not downloaded yet
2026-03-27 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/2.jpg not downloaded yet
2026-03-27 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/3.jpg not downloaded yet
2026-03-27 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/4.jpg not downloaded yet
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/5.jpg not downloaded yet
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/6.jpg not downloaded yet
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/7.jpg not downloaded yet
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bff550>
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/8.jpg saved to cache
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68955710>
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/9.jpg saved to cache
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d10350>
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/10.jpg saved to cache
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/8.jpg not downloaded yet
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936acd0>
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/3.jpg saved to cache
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b3167d0>
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/9.jpg saved to cache
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/9.jpg not downloaded yet
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/10.jpg not downloaded yet
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8ce10>
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/2.jpg saved to cache
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68febb50>
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/1.jpg saved to cache
2026-03-27 16:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c7b6d0>
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/4.jpg saved to cache
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:40 [ayvens.it] INFO: Found listing with ID: 1988832
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988832%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [ayvens.it] INFO: Scrape type for 1988832: 1
2026-03-27 16:31:40 [ayvens.it] INFO: Extracting data for car ID: 1988832
2026-03-27 16:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44ebe2bd-3d94-51c2-9bed-b612bff4f773 with identifier: 1988832
2026-03-27 16:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773 with scrape type 1
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/1.jpg not downloaded yet
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/2.jpg not downloaded yet
2026-03-27 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/3.jpg not downloaded yet
2026-03-27 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/4.jpg not downloaded yet
2026-03-27 16:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/5.jpg not downloaded yet
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/6.jpg not downloaded yet
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/7.jpg not downloaded yet
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/8.jpg not downloaded yet
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69019b50>
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/3.jpg saved to cache
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5d9d0>
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/7.jpg saved to cache
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68530a90>
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/8.jpg saved to cache
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b5690>
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/6.jpg saved to cache
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/9.jpg not downloaded yet
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba3290>
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/2.jpg saved to cache
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1ce10>
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/4.jpg saved to cache
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68517910>
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/1.jpg saved to cache
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/10.jpg not downloaded yet
2026-03-27 16:31:40 [ayvens.it] INFO: Found listing with ID: 1988833
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988833%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [ayvens.it] INFO: Scrape type for 1988833: 1
2026-03-27 16:31:40 [ayvens.it] INFO: Extracting data for car ID: 1988833
2026-03-27 16:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2288d3f2-666e-5e45-8549-1b8e0466441e with identifier: 1988833
2026-03-27 16:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2288d3f2-666e-5e45-8549-1b8e0466441e with scrape type 1
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/1.jpg not downloaded yet
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b55190>
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/5.jpg saved to cache
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/2.jpg not downloaded yet
2026-03-27 16:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/3.jpg not downloaded yet
2026-03-27 16:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/4.jpg not downloaded yet
2026-03-27 16:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/5.jpg not downloaded yet
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/6.jpg not downloaded yet
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/7.jpg not downloaded yet
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcd750>
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/8.jpg saved to cache
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bd9c50>
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/2.jpg saved to cache
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/8.jpg not downloaded yet
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/9.jpg not downloaded yet
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/10.jpg not downloaded yet
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835d850>
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/1.jpg saved to cache
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aea710>
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/8.jpg saved to cache
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69090210>
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/7.jpg saved to cache
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68adfad0>
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/10.jpg saved to cache
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3c890>
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/6.jpg saved to cache
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ae82d0>
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/9.jpg saved to cache
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:31:41 [ayvens.it] INFO: Found listing with ID: 1988834
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988834%27 HTTP/1.1" 200 None
2026-03-27 16:31:41 [ayvens.it] INFO: Scrape type for 1988834: 1
2026-03-27 16:31:41 [ayvens.it] INFO: Extracting data for car ID: 1988834
2026-03-27 16:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed with identifier: 1988834
2026-03-27 16:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed with scrape type 1
2026-03-27 16:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/1.jpg not downloaded yet
2026-03-27 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/2.jpg not downloaded yet
2026-03-27 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/3.jpg not downloaded yet
2026-03-27 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/4.jpg not downloaded yet
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/5.jpg not downloaded yet
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/6.jpg not downloaded yet
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/7.jpg not downloaded yet
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/8.jpg not downloaded yet
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfd910>
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/4.jpg saved to cache
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/9.jpg not downloaded yet
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900bc10>
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/10.jpg saved to cache
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4bed0>
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/9.jpg saved to cache
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfcf50>
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/2.jpg saved to cache
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/10.jpg not downloaded yet
2026-03-27 16:31:43 [ayvens.it] INFO: Found listing with ID: 1988835
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988835%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [ayvens.it] INFO: Scrape type for 1988835: 1
2026-03-27 16:31:43 [ayvens.it] INFO: Extracting data for car ID: 1988835
2026-03-27 16:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a51652c-01a8-539a-97fd-f79b31218eb3 with identifier: 1988835
2026-03-27 16:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a51652c-01a8-539a-97fd-f79b31218eb3 with scrape type 1
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/1.jpg not downloaded yet
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd6550>
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/5.jpg saved to cache
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fe8b50>
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/8.jpg saved to cache
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef4550>
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/1.jpg saved to cache
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5a210>
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/9.jpg saved to cache
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/2.jpg not downloaded yet
2026-03-27 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/3.jpg not downloaded yet
2026-03-27 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/4.jpg not downloaded yet
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/5.jpg not downloaded yet
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/6.jpg not downloaded yet
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/7.jpg not downloaded yet
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/8.jpg not downloaded yet
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b32110>
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/6.jpg saved to cache
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc6550>
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/8.jpg saved to cache
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/9.jpg not downloaded yet
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb5cd0>
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/7.jpg saved to cache
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/10.jpg not downloaded yet
2026-03-27 16:31:43 [ayvens.it] INFO: Found listing with ID: 1988836
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988836%27 HTTP/1.1" 200 None
2026-03-27 16:31:43 [ayvens.it] INFO: Scrape type for 1988836: 1
2026-03-27 16:31:43 [ayvens.it] INFO: Extracting data for car ID: 1988836
2026-03-27 16:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e34e4a9-718b-5484-b363-748022835342 with identifier: 1988836
2026-03-27 16:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e34e4a9-718b-5484-b363-748022835342 with scrape type 1
2026-03-27 16:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/1.jpg not downloaded yet
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd2910>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/2.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5f410>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/6.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b75d0>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/7.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68515490>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/1.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecc210>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/10.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/2.jpg not downloaded yet
2026-03-27 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/3.jpg not downloaded yet
2026-03-27 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/4.jpg not downloaded yet
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/5.jpg not downloaded yet
2026-03-27 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/6.jpg not downloaded yet
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/7.jpg not downloaded yet
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/8.jpg not downloaded yet
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/9.jpg not downloaded yet
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2e5d0>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/9.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b1ad10>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/7.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936be10>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/8.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/10.jpg not downloaded yet
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a585d0>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/9.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685206d0>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/10.jpg saved to cache
2026-03-27 16:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd4390>
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/10.jpg saved to cache
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:31:45 [ayvens.it] INFO: Found listing with ID: 1988837
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988837%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [ayvens.it] INFO: Scrape type for 1988837: 1
2026-03-27 16:31:45 [ayvens.it] INFO: Extracting data for car ID: 1988837
2026-03-27 16:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead04d4b-360e-5950-a763-af7a017866e5 with identifier: 1988837
2026-03-27 16:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead04d4b-360e-5950-a763-af7a017866e5 with scrape type 1
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/1.jpg not downloaded yet
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/2.jpg not downloaded yet
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68520210>
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/2.jpg saved to cache
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69091c50>
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/1.jpg saved to cache
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/3.jpg not downloaded yet
2026-03-27 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/4.jpg not downloaded yet
2026-03-27 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/5.jpg not downloaded yet
2026-03-27 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/6.jpg not downloaded yet
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/7.jpg not downloaded yet
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/8.jpg not downloaded yet
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5e850>
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/6.jpg saved to cache
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/9.jpg not downloaded yet
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69514190>
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/8.jpg saved to cache
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/10.jpg not downloaded yet
2026-03-27 16:31:45 [ayvens.it] INFO: Found listing with ID: 1988838
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988838%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [ayvens.it] INFO: Scrape type for 1988838: 1
2026-03-27 16:31:45 [ayvens.it] INFO: Extracting data for car ID: 1988838
2026-03-27 16:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e021f672-d8f2-5a26-8233-d8a7088dcfe7 with identifier: 1988838
2026-03-27 16:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e021f672-d8f2-5a26-8233-d8a7088dcfe7 with scrape type 1
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/1.jpg not downloaded yet
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69072b90>
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/2.jpg saved to cache
2026-03-27 16:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd0610>
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/1.jpg saved to cache
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68531e90>
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/5.jpg saved to cache
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68955b10>
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/6.jpg saved to cache
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69355350>
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/7.jpg saved to cache
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1ee90>
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/9.jpg saved to cache
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/2.jpg not downloaded yet
2026-03-27 16:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/3.jpg not downloaded yet
2026-03-27 16:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/4.jpg not downloaded yet
2026-03-27 16:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/5.jpg not downloaded yet
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/6.jpg not downloaded yet
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/7.jpg not downloaded yet
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/8.jpg not downloaded yet
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad12910>
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/2.jpg saved to cache
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/9.jpg not downloaded yet
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68545c50>
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/9.jpg saved to cache
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/10.jpg not downloaded yet
2026-03-27 16:31:46 [ayvens.it] INFO: Found listing with ID: 1988839
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988839%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [ayvens.it] INFO: Scrape type for 1988839: 1
2026-03-27 16:31:46 [ayvens.it] INFO: Extracting data for car ID: 1988839
2026-03-27 16:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8d983f6-d763-5a31-bc71-7997acc650fc with identifier: 1988839
2026-03-27 16:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d983f6-d763-5a31-bc71-7997acc650fc with scrape type 1
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/1.jpg not downloaded yet
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d12c50>
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/3.jpg saved to cache
2026-03-27 16:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68608490>
2026-03-27 16:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/4.jpg saved to cache
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d36f90>
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/3.jpg saved to cache
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf62d0>
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft9%252F14b021827d3f4154af732b877aceca93%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/10.jpg saved to cache
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a51652c-01a8-539a-97fd-f79b31218eb3
2026-03-27 16:31:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a51652c-01a8-539a-97fd-f79b31218eb3, skipping ID generation
2026-03-27 16:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a51652c-01a8-539a-97fd-f79b31218eb3 with scrape type 1
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a51652c-01a8-539a-97fd-f79b31218eb3 sending to next pipeline
2026-03-27 16:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2a51652c-01a8-539a-97fd-f79b31218eb3, identifier: 1988835
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d45790>
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/1.jpg saved to cache
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc6ad0>
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/10.jpg saved to cache
2026-03-27 16:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2a51652c-01a8-539a-97fd-f79b31218eb3 with identifier: 1988835
2026-03-27 16:31:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2a51652c-01a8-539a-97fd-f79b31218eb3 with identifier: 1988835
2026-03-27 16:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2a51652c-01a8-539a-97fd-f79b31218eb3 with identifier: 1988835 to the API
2026-03-27 16:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Dark Metal Grey metallic',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '2a51652c-01a8-539a-97fd-f79b31218eb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI 1.5 dCi 115 Business Cross over 5-d',
'odometer': 104808,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 818940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387675,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a51652c-01a8-539a-97fd-f79b31218eb3/2a51652c-01a8-539a-97fd-f79b31218eb3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704347,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft9/14b021827d3f4154af732b877aceca93/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-14',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI 1.5 dCi 115 Business Cross over 5-d -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988835%27 HTTP/1.1" 200 None
2026-03-27 16:31:48 [ayvens.it] INFO: Saving data for 1988835: {'created_time': 1774629108.133113, 'last_price_update_time': 1774629108.133123, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988835') HTTP/1.1" 204 0
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/2.jpg not downloaded yet
2026-03-27 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/3.jpg not downloaded yet
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/4.jpg not downloaded yet
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/5.jpg not downloaded yet
2026-03-27 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/6.jpg not downloaded yet
2026-03-27 16:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/7.jpg not downloaded yet
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/8.jpg not downloaded yet
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/9.jpg not downloaded yet
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ace190>
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/3.jpg saved to cache
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5ca10>
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/7.jpg saved to cache
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69236d10>
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/8.jpg saved to cache
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835e590>
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/8.jpg saved to cache
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8ccd0>
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/4.jpg saved to cache
2026-03-27 16:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/10.jpg not downloaded yet
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923cd50>
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/2.jpg saved to cache
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd4310>
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/9.jpg saved to cache
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68500250>
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/1.jpg saved to cache
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:49 [ayvens.it] INFO: Found listing with ID: 1988840
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988840%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [ayvens.it] INFO: Scrape type for 1988840: 1
2026-03-27 16:31:49 [ayvens.it] INFO: Extracting data for car ID: 1988840
2026-03-27 16:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65e4f635-5ed4-5cbe-8905-6067a9074d20 with identifier: 1988840
2026-03-27 16:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e4f635-5ed4-5cbe-8905-6067a9074d20 with scrape type 1
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/1.jpg not downloaded yet
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/2.jpg not downloaded yet
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/3.jpg not downloaded yet
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/4.jpg not downloaded yet
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/5.jpg not downloaded yet
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/6.jpg not downloaded yet
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/7.jpg not downloaded yet
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d96d0>
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/2.jpg saved to cache
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69162790>
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/7.jpg saved to cache
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f2d10>
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/9.jpg saved to cache
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/8.jpg not downloaded yet
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b01950>
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/8.jpg saved to cache
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/9.jpg not downloaded yet
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/10.jpg not downloaded yet
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694da250>
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/1.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68611b10>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/7.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c0b190>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/10.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18f10>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/6.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:50 [ayvens.it] INFO: Found listing with ID: 1988841
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988841%27 HTTP/1.1" 200 None
2026-03-27 16:31:50 [ayvens.it] INFO: Scrape type for 1988841: 1
2026-03-27 16:31:50 [ayvens.it] INFO: Extracting data for car ID: 1988841
2026-03-27 16:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b84703-cc6f-5599-b882-6999b8fbdbf6 with identifier: 1988841
2026-03-27 16:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b84703-cc6f-5599-b882-6999b8fbdbf6 with scrape type 1
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/1.jpg not downloaded yet
2026-03-27 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/2.jpg not downloaded yet
2026-03-27 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c57cd0>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/10.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acc490>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/10.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/3.jpg not downloaded yet
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/4.jpg not downloaded yet
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/5.jpg not downloaded yet
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69515090>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/5.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c86550>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/5.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aeb010>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/2.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc2fd0>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/6.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef50d0>
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/1.jpg saved to cache
2026-03-27 16:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/6.jpg not downloaded yet
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/7.jpg not downloaded yet
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3dd10>
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/4.jpg saved to cache
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/8.jpg not downloaded yet
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/9.jpg not downloaded yet
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/10.jpg not downloaded yet
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68508c90>
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/3.jpg saved to cache
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8d9d0>
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/8.jpg saved to cache
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [ayvens.it] INFO: Found listing with ID: 1988842
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988842%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [ayvens.it] INFO: Scrape type for 1988842: 1
2026-03-27 16:31:51 [ayvens.it] INFO: Extracting data for car ID: 1988842
2026-03-27 16:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3de3ad-921a-5c11-8a95-f601d1d8839a with identifier: 1988842
2026-03-27 16:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3de3ad-921a-5c11-8a95-f601d1d8839a with scrape type 1
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/1.jpg not downloaded yet
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/2.jpg not downloaded yet
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d10d10>
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/9.jpg saved to cache
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c86a90>
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/1.jpg saved to cache
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba27d0>
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/2.jpg saved to cache
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914d910>
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/4.jpg saved to cache
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba0350>
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/7.jpg saved to cache
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/3.jpg not downloaded yet
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/4.jpg not downloaded yet
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/5.jpg not downloaded yet
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b72050>
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/5.jpg saved to cache
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/6.jpg not downloaded yet
2026-03-27 16:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/7.jpg not downloaded yet
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694dbed0>
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/9.jpg saved to cache
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f076d0>
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/10.jpg saved to cache
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc5390>
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/8.jpg saved to cache
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c5210>
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/6.jpg saved to cache
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/8.jpg not downloaded yet
2026-03-27 16:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/9.jpg not downloaded yet
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/10.jpg not downloaded yet
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1e210>
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F2ab3cd03148042e5b9cb203b879e1e23%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/7.jpg saved to cache
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65e4f635-5ed4-5cbe-8905-6067a9074d20
2026-03-27 16:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65e4f635-5ed4-5cbe-8905-6067a9074d20, skipping ID generation
2026-03-27 16:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e4f635-5ed4-5cbe-8905-6067a9074d20 with scrape type 1
2026-03-27 16:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65e4f635-5ed4-5cbe-8905-6067a9074d20 sending to next pipeline
2026-03-27 16:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 65e4f635-5ed4-5cbe-8905-6067a9074d20, identifier: 1988840
2026-03-27 16:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684fa0d0>
2026-03-27 16:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/6.jpg saved to cache
2026-03-27 16:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef4050>
2026-03-27 16:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/2.jpg saved to cache
2026-03-27 16:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 65e4f635-5ed4-5cbe-8905-6067a9074d20 with identifier: 1988840
2026-03-27 16:31:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 65e4f635-5ed4-5cbe-8905-6067a9074d20 with identifier: 1988840
2026-03-27 16:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 65e4f635-5ed4-5cbe-8905-6067a9074d20 with identifier: 1988840 to the API
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Fuji White pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '65e4f635-5ed4-5cbe-8905-6067a9074d20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 Standard FWD Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 125223,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633139,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295516,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461632,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 612062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561268,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e4f635-5ed4-5cbe-8905-6067a9074d20/65e4f635-5ed4-5cbe-8905-6067a9074d20_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481089,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/2ab3cd03148042e5b9cb203b879e1e23/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVOQUE 2.0 D163 Standard FWD '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988840%27 HTTP/1.1" 200 None
2026-03-27 16:31:53 [ayvens.it] INFO: Saving data for 1988840: {'created_time': 1774629113.979965, 'last_price_update_time': 1774629113.979976, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988840') HTTP/1.1" 204 0
2026-03-27 16:31:54 [ayvens.it] INFO: Found listing with ID: 1988843
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988843%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [ayvens.it] INFO: Scrape type for 1988843: 1
2026-03-27 16:31:54 [ayvens.it] INFO: Extracting data for car ID: 1988843
2026-03-27 16:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 377acd9c-f04d-5810-8137-41a86cbb522d with identifier: 1988843
2026-03-27 16:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 377acd9c-f04d-5810-8137-41a86cbb522d with scrape type 1
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/1.jpg not downloaded yet
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/2.jpg not downloaded yet
2026-03-27 16:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a685d0>
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/1.jpg saved to cache
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/3.jpg not downloaded yet
2026-03-27 16:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/4.jpg not downloaded yet
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/5.jpg not downloaded yet
2026-03-27 16:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/6.jpg not downloaded yet
2026-03-27 16:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922ff50>
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/5.jpg saved to cache
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/7.jpg not downloaded yet
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/8.jpg not downloaded yet
2026-03-27 16:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/9.jpg not downloaded yet
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c13250>
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/4.jpg saved to cache
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdcc10>
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/6.jpg saved to cache
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdfc10>
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/9.jpg saved to cache
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6b190>
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/7.jpg saved to cache
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6a850>
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/8.jpg saved to cache
2026-03-27 16:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a6b290>
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/3.jpg saved to cache
2026-03-27 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b891d0>
2026-03-27 16:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252Fe6551279c6c241259309754ac5d39c7f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/10.jpg saved to cache
2026-03-27 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7b84703-cc6f-5599-b882-6999b8fbdbf6
2026-03-27 16:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7b84703-cc6f-5599-b882-6999b8fbdbf6, skipping ID generation
2026-03-27 16:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b84703-cc6f-5599-b882-6999b8fbdbf6 with scrape type 1
2026-03-27 16:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7b84703-cc6f-5599-b882-6999b8fbdbf6 sending to next pipeline
2026-03-27 16:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c7b84703-cc6f-5599-b882-6999b8fbdbf6, identifier: 1988841
2026-03-27 16:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c7b84703-cc6f-5599-b882-6999b8fbdbf6 with identifier: 1988841
2026-03-27 16:31:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c7b84703-cc6f-5599-b882-6999b8fbdbf6 with identifier: 1988841
2026-03-27 16:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c7b84703-cc6f-5599-b882-6999b8fbdbf6 with identifier: 1988841 to the API
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SPARKLING SILVER',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'c7b84703-cc6f-5599-b882-6999b8fbdbf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'KIA SPORTAGE (PC) 1.6 CRDI MHYB 100KW BUSIN. CLASS DCT 2WD',
'odometer': 122364,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 761830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592880,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618557,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552824,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642341,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702170,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649855,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b84703-cc6f-5599-b882-6999b8fbdbf6/c7b84703-cc6f-5599-b882-6999b8fbdbf6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 730655,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/e6551279c6c241259309754ac5d39c7f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'KIA KIA SPORTAGE (PC) 1.6 CRDI MHYB 100KW BUSIN. CLASS DCT 2WD -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988841%27 HTTP/1.1" 200 None
2026-03-27 16:31:56 [ayvens.it] INFO: Saving data for 1988841: {'created_time': 1774629116.021778, 'last_price_update_time': 1774629116.021788, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988841') HTTP/1.1" 204 0
2026-03-27 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/10.jpg not downloaded yet
2026-03-27 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:56 [ayvens.it] INFO: Found listing with ID: 1988844
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988844%27 HTTP/1.1" 200 None
2026-03-27 16:31:56 [ayvens.it] INFO: Scrape type for 1988844: 1
2026-03-27 16:31:56 [ayvens.it] INFO: Extracting data for car ID: 1988844
2026-03-27 16:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0825b3f1-5543-5675-a151-e4f2f58b8335 with identifier: 1988844
2026-03-27 16:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0825b3f1-5543-5675-a151-e4f2f58b8335 with scrape type 1
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/1.jpg not downloaded yet
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68523350>
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F6212601b27c044f68518129e5a4082b4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/3.jpg saved to cache
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8d983f6-d763-5a31-bc71-7997acc650fc
2026-03-27 16:31:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8d983f6-d763-5a31-bc71-7997acc650fc, skipping ID generation
2026-03-27 16:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d983f6-d763-5a31-bc71-7997acc650fc with scrape type 1
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8d983f6-d763-5a31-bc71-7997acc650fc sending to next pipeline
2026-03-27 16:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b8d983f6-d763-5a31-bc71-7997acc650fc, identifier: 1988839
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/2.jpg not downloaded yet
2026-03-27 16:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b8d983f6-d763-5a31-bc71-7997acc650fc with identifier: 1988839
2026-03-27 16:31:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b8d983f6-d763-5a31-bc71-7997acc650fc with identifier: 1988839
2026-03-27 16:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b8d983f6-d763-5a31-bc71-7997acc650fc with identifier: 1988839 to the API
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ARTICO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'b8d983f6-d763-5a31-bc71-7997acc650fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES SPRINTER 311 CDI F39/33 T.ALTO P.M. TR.ANT. FP',
'odometer': 175026,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666345,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170717,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304148,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484367,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d983f6-d763-5a31-bc71-7997acc650fc/b8d983f6-d763-5a31-bc71-7997acc650fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/6212601b27c044f68518129e5a4082b4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES SPRINTER 311 CDI F39/33 T.ALTO P.M. TR.ANT. '
'FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988839%27 HTTP/1.1" 200 None
2026-03-27 16:31:56 [ayvens.it] INFO: Saving data for 1988839: {'created_time': 1774629116.780964, 'last_price_update_time': 1774629116.780976, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988839') HTTP/1.1" 204 0
2026-03-27 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/3.jpg not downloaded yet
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc9a90>
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/5.jpg saved to cache
2026-03-27 16:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900ac90>
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/2.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6850b350>
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/4.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900bd10>
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/6.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b640d0>
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/8.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/4.jpg not downloaded yet
2026-03-27 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/5.jpg not downloaded yet
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ade5690>
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/1.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835c7d0>
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/3.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/6.jpg not downloaded yet
2026-03-27 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/7.jpg not downloaded yet
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/8.jpg not downloaded yet
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68530f50>
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/9.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853dad0>
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/10.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/9.jpg not downloaded yet
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/10.jpg not downloaded yet
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ee5d0>
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/1.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf6010>
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4f19744bbf3a4685a0b4f4f996754dcd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/7.jpg saved to cache
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf3de3ad-921a-5c11-8a95-f601d1d8839a
2026-03-27 16:31:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf3de3ad-921a-5c11-8a95-f601d1d8839a, skipping ID generation
2026-03-27 16:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3de3ad-921a-5c11-8a95-f601d1d8839a with scrape type 1
2026-03-27 16:31:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf3de3ad-921a-5c11-8a95-f601d1d8839a sending to next pipeline
2026-03-27 16:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cf3de3ad-921a-5c11-8a95-f601d1d8839a, identifier: 1988842
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ade7cd0>
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/2.jpg saved to cache
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922e710>
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/3.jpg saved to cache
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:58 [ayvens.it] INFO: Found listing with ID: 1988845
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988845%27 HTTP/1.1" 200 None
2026-03-27 16:31:58 [ayvens.it] INFO: Scrape type for 1988845: 1
2026-03-27 16:31:58 [ayvens.it] INFO: Extracting data for car ID: 1988845
2026-03-27 16:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 855128d7-ef37-5b3b-bdff-f256bfe4ac4d with identifier: 1988845
2026-03-27 16:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d with scrape type 1
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/1.jpg not downloaded yet
2026-03-27 16:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cf3de3ad-921a-5c11-8a95-f601d1d8839a with identifier: 1988842
2026-03-27 16:31:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cf3de3ad-921a-5c11-8a95-f601d1d8839a with identifier: 1988842
2026-03-27 16:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cf3de3ad-921a-5c11-8a95-f601d1d8839a with identifier: 1988842 to the API
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DARK BLUE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'cf3de3ad-921a-5c11-8a95-f601d1d8839a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP',
'odometer': 93705,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 84,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765295,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765295,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294777,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3de3ad-921a-5c11-8a95-f601d1d8839a/cf3de3ad-921a-5c11-8a95-f601d1d8839a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4f19744bbf3a4685a0b4f4f996754dcd/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988842%27 HTTP/1.1" 200 None
2026-03-27 16:31:58 [ayvens.it] INFO: Saving data for 1988842: {'created_time': 1774629118.600134, 'last_price_update_time': 1774629118.600144, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988842') HTTP/1.1" 204 0
2026-03-27 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/2.jpg not downloaded yet
2026-03-27 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/3.jpg not downloaded yet
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf7ad0>
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/4.jpg saved to cache
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2f950>
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/8.jpg saved to cache
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/4.jpg not downloaded yet
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/5.jpg not downloaded yet
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0f0d0>
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/4.jpg saved to cache
2026-03-27 16:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835ec10>
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/5.jpg saved to cache
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69369590>
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/10.jpg saved to cache
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/6.jpg not downloaded yet
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/7.jpg not downloaded yet
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/8.jpg not downloaded yet
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835f110>
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/6.jpg saved to cache
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c5e90>
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/9.jpg saved to cache
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d02390>
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt6%252F5c3660c98bba40289c3d7e07118c1d47%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/7.jpg saved to cache
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 377acd9c-f04d-5810-8137-41a86cbb522d
2026-03-27 16:31:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 377acd9c-f04d-5810-8137-41a86cbb522d, skipping ID generation
2026-03-27 16:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 377acd9c-f04d-5810-8137-41a86cbb522d with scrape type 1
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 377acd9c-f04d-5810-8137-41a86cbb522d sending to next pipeline
2026-03-27 16:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 377acd9c-f04d-5810-8137-41a86cbb522d, identifier: 1988843
2026-03-27 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 377acd9c-f04d-5810-8137-41a86cbb522d with identifier: 1988843
2026-03-27 16:31:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 377acd9c-f04d-5810-8137-41a86cbb522d with identifier: 1988843
2026-03-27 16:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 377acd9c-f04d-5810-8137-41a86cbb522d with identifier: 1988843 to the API
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SANTORINI BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '377acd9c-f04d-5810-8137-41a86cbb522d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVOQUE 2.0D I4 163 MHEV S AWD auto Sport '
'utility vehicle 5-door (Euro 6D)',
'odometer': 22249,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743922,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_377acd9c-f04d-5810-8137-41a86cbb522d/377acd9c-f04d-5810-8137-41a86cbb522d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt6/5c3660c98bba40289c3d7e07118c1d47/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVOQUE 2.0D I4 163 MHEV S AWD '
'auto Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988843%27 HTTP/1.1" 200 None
2026-03-27 16:31:59 [ayvens.it] INFO: Saving data for 1988843: {'created_time': 1774629119.862918, 'last_price_update_time': 1774629119.862932, 'auction_closing_time': 1774944000.0}
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988843') HTTP/1.1" 204 0
2026-03-27 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/9.jpg not downloaded yet
2026-03-27 16:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/10.jpg not downloaded yet
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b82ed0>
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/2.jpg saved to cache
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853dc50>
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/4.jpg saved to cache
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1d390>
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/5.jpg saved to cache
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:00 [ayvens.it] INFO: Found listing with ID: 1988846
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988846%27 HTTP/1.1" 200 None
2026-03-27 16:32:00 [ayvens.it] INFO: Scrape type for 1988846: 1
2026-03-27 16:32:00 [ayvens.it] INFO: Extracting data for car ID: 1988846
2026-03-27 16:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2d71540-f2b4-55fd-9496-439d6a40639e with identifier: 1988846
2026-03-27 16:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d71540-f2b4-55fd-9496-439d6a40639e with scrape type 1
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/1.jpg not downloaded yet
2026-03-27 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/2.jpg not downloaded yet
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d02890>
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/1.jpg saved to cache
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c56bd0>
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/6.jpg saved to cache
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e6a10>
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F615d68ed2e414d1aaa0ed00b10d210a4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/3.jpg saved to cache
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e021f672-d8f2-5a26-8233-d8a7088dcfe7
2026-03-27 16:32:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e021f672-d8f2-5a26-8233-d8a7088dcfe7, skipping ID generation
2026-03-27 16:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e021f672-d8f2-5a26-8233-d8a7088dcfe7 with scrape type 1
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e021f672-d8f2-5a26-8233-d8a7088dcfe7 sending to next pipeline
2026-03-27 16:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e021f672-d8f2-5a26-8233-d8a7088dcfe7, identifier: 1988838
2026-03-27 16:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e021f672-d8f2-5a26-8233-d8a7088dcfe7 with identifier: 1988838
2026-03-27 16:32:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e021f672-d8f2-5a26-8233-d8a7088dcfe7 with identifier: 1988838
2026-03-27 16:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e021f672-d8f2-5a26-8233-d8a7088dcfe7 with identifier: 1988838 to the API
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Night Shade Blue Metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'e021f672-d8f2-5a26-8233-d8a7088dcfe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 113047,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591884,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280173,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e021f672-d8f2-5a26-8233-d8a7088dcfe7/e021f672-d8f2-5a26-8233-d8a7088dcfe7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300170,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/615d68ed2e414d1aaa0ed00b10d210a4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988838%27 HTTP/1.1" 200 None
2026-03-27 16:32:00 [ayvens.it] INFO: Saving data for 1988838: {'created_time': 1774629120.960797, 'last_price_update_time': 1774629120.96081, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988838') HTTP/1.1" 204 0
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/3.jpg not downloaded yet
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/4.jpg not downloaded yet
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef7190>
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/3.jpg saved to cache
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc8410>
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F528aeef27c964641bcdebfa5fea8836e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/5.jpg saved to cache
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ead04d4b-360e-5950-a763-af7a017866e5
2026-03-27 16:32:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ead04d4b-360e-5950-a763-af7a017866e5, skipping ID generation
2026-03-27 16:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead04d4b-360e-5950-a763-af7a017866e5 with scrape type 1
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ead04d4b-360e-5950-a763-af7a017866e5 sending to next pipeline
2026-03-27 16:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ead04d4b-360e-5950-a763-af7a017866e5, identifier: 1988837
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0dc50>
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/10.jpg saved to cache
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/5.jpg not downloaded yet
2026-03-27 16:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ead04d4b-360e-5950-a763-af7a017866e5 with identifier: 1988837
2026-03-27 16:32:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ead04d4b-360e-5950-a763-af7a017866e5 with identifier: 1988837
2026-03-27 16:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ead04d4b-360e-5950-a763-af7a017866e5 with identifier: 1988837 to the API
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SANTORINI BLACK MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'ead04d4b-360e-5950-a763-af7a017866e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 2.0D I4 163 MHEV SE AWD AUTO N1 FP',
'odometer': 32733,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 906046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 906046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555600,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 771116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 838901,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637392,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead04d4b-360e-5950-a763-af7a017866e5/ead04d4b-360e-5950-a763-af7a017866e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 710068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/528aeef27c964641bcdebfa5fea8836e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 2.0D I4 163 MHEV SE AWD AUTO '
'N1 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988837%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [ayvens.it] INFO: Saving data for 1988837: {'created_time': 1774629121.755432, 'last_price_update_time': 1774629121.755443, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988837') HTTP/1.1" 204 0
2026-03-27 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/6.jpg not downloaded yet
2026-03-27 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/7.jpg not downloaded yet
2026-03-27 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/8.jpg not downloaded yet
2026-03-27 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/9.jpg not downloaded yet
2026-03-27 16:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/10.jpg not downloaded yet
2026-03-27 16:32:01 [ayvens.it] INFO: Found listing with ID: 1988847
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988847%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [ayvens.it] INFO: Scrape type for 1988847: 1
2026-03-27 16:32:01 [ayvens.it] INFO: Extracting data for car ID: 1988847
2026-03-27 16:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61c78b58-c522-5146-9c1f-eccf733ce454 with identifier: 1988847
2026-03-27 16:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61c78b58-c522-5146-9c1f-eccf733ce454 with scrape type 1
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/1.jpg not downloaded yet
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/2.jpg not downloaded yet
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd4d50>
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/7.jpg saved to cache
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/3.jpg not downloaded yet
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c842d0>
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/8.jpg saved to cache
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb74d0>
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/6.jpg saved to cache
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853cb10>
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/2.jpg saved to cache
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd7c10>
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252F8fa72f344a6b4ca48fdd22c12cba9209%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/9.jpg saved to cache
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0825b3f1-5543-5675-a151-e4f2f58b8335
2026-03-27 16:32:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0825b3f1-5543-5675-a151-e4f2f58b8335, skipping ID generation
2026-03-27 16:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0825b3f1-5543-5675-a151-e4f2f58b8335 with scrape type 1
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0825b3f1-5543-5675-a151-e4f2f58b8335 sending to next pipeline
2026-03-27 16:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0825b3f1-5543-5675-a151-e4f2f58b8335, identifier: 1988844
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69018e50>
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/1.jpg saved to cache
2026-03-27 16:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0825b3f1-5543-5675-a151-e4f2f58b8335 with identifier: 1988844
2026-03-27 16:32:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0825b3f1-5543-5675-a151-e4f2f58b8335 with identifier: 1988844
2026-03-27 16:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0825b3f1-5543-5675-a151-e4f2f58b8335 with identifier: 1988844 to the API
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '0825b3f1-5543-5675-a151-e4f2f58b8335',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO (PC) 35 LH2 2.3 MULTIJET 140CV E6D-TEMP FP',
'odometer': 131263,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300534,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 786371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262067,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 787788,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0825b3f1-5543-5675-a151-e4f2f58b8335/0825b3f1-5543-5675-a151-e4f2f58b8335_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/8fa72f344a6b4ca48fdd22c12cba9209/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-22',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO (PC) 35 LH2 2.3 MULTIJET 140CV E6D-TEMP FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988844%27 HTTP/1.1" 200 None
2026-03-27 16:32:02 [ayvens.it] INFO: Saving data for 1988844: {'created_time': 1774629122.985522, 'last_price_update_time': 1774629122.985531, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988844') HTTP/1.1" 204 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/4.jpg not downloaded yet
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68523c50>
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/3.jpg saved to cache
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b56750>
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/5.jpg saved to cache
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/5.jpg not downloaded yet
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/6.jpg not downloaded yet
2026-03-27 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/7.jpg not downloaded yet
2026-03-27 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/8.jpg not downloaded yet
2026-03-27 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/9.jpg not downloaded yet
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/10.jpg not downloaded yet
2026-03-27 16:32:03 [ayvens.it] INFO: Found listing with ID: 1988848
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988848%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [ayvens.it] INFO: Scrape type for 1988848: 1
2026-03-27 16:32:03 [ayvens.it] INFO: Extracting data for car ID: 1988848
2026-03-27 16:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca892a8-1055-5334-bc2d-3429b13ba531 with identifier: 1988848
2026-03-27 16:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca892a8-1055-5334-bc2d-3429b13ba531 with scrape type 1
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/1.jpg not downloaded yet
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/2.jpg not downloaded yet
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b29a90>
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/5.jpg saved to cache
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8d410>
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/7.jpg saved to cache
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf4e90>
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/8.jpg saved to cache
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8f350>
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/4.jpg saved to cache
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b30190>
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/10.jpg saved to cache
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c87110>
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/6.jpg saved to cache
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/3.jpg not downloaded yet
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c68ad0>
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252F688bf05d8ef447ee8ac65c1cca7f5897%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/9.jpg saved to cache
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d
2026-03-27 16:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 855128d7-ef37-5b3b-bdff-f256bfe4ac4d, skipping ID generation
2026-03-27 16:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d with scrape type 1
2026-03-27 16:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 855128d7-ef37-5b3b-bdff-f256bfe4ac4d sending to next pipeline
2026-03-27 16:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 855128d7-ef37-5b3b-bdff-f256bfe4ac4d, identifier: 1988845
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68545a10>
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/1.jpg saved to cache
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/4.jpg not downloaded yet
2026-03-27 16:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 855128d7-ef37-5b3b-bdff-f256bfe4ac4d with identifier: 1988845
2026-03-27 16:32:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 855128d7-ef37-5b3b-bdff-f256bfe4ac4d with identifier: 1988845
2026-03-27 16:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 855128d7-ef37-5b3b-bdff-f256bfe4ac4d with identifier: 1988845 to the API
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO MANGANO METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '855128d7-ef37-5b3b-bdff-f256bfe4ac4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN PASSAT Var. 2.0TDI SCR EVO 110kW Business DSG SW 5-door '
'(Euro 6.2)',
'odometer': 160567,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 819478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 798646,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 844167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 713806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660924,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 761739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855128d7-ef37-5b3b-bdff-f256bfe4ac4d/855128d7-ef37-5b3b-bdff-f256bfe4ac4d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/688bf05d8ef447ee8ac65c1cca7f5897/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-13',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN PASSAT Var. 2.0TDI SCR EVO 110kW Business DSG '
'SW 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988845%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [ayvens.it] INFO: Saving data for 1988845: {'created_time': 1774629124.643439, 'last_price_update_time': 1774629124.643449, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988845') HTTP/1.1" 204 0
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/5.jpg not downloaded yet
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/6.jpg not downloaded yet
2026-03-27 16:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/7.jpg not downloaded yet
2026-03-27 16:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/8.jpg not downloaded yet
2026-03-27 16:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/9.jpg not downloaded yet
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/10.jpg not downloaded yet
2026-03-27 16:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:04 [ayvens.it] INFO: Found listing with ID: 1988849
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988849%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [ayvens.it] INFO: Scrape type for 1988849: 1
2026-03-27 16:32:04 [ayvens.it] INFO: Extracting data for car ID: 1988849
2026-03-27 16:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22386387-ccf1-50fb-a45c-eb30dbc4b4a5 with identifier: 1988849
2026-03-27 16:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5 with scrape type 1
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/1.jpg not downloaded yet
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/2.jpg not downloaded yet
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6a810>
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/7.jpg saved to cache
2026-03-27 16:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0ff90>
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/6.jpg saved to cache
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69355190>
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/5.jpg saved to cache
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69516a90>
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/2.jpg saved to cache
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ae94d0>
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/3.jpg saved to cache
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad11210>
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/3.jpg saved to cache
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69357f10>
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/4.jpg saved to cache
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/3.jpg not downloaded yet
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/4.jpg not downloaded yet
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/5.jpg not downloaded yet
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdc910>
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/4.jpg saved to cache
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/6.jpg not downloaded yet
2026-03-27 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/7.jpg not downloaded yet
2026-03-27 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/8.jpg not downloaded yet
2026-03-27 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/9.jpg not downloaded yet
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/10.jpg not downloaded yet
2026-03-27 16:32:05 [ayvens.it] INFO: Found listing with ID: 1988850
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988850%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [ayvens.it] INFO: Scrape type for 1988850: 1
2026-03-27 16:32:05 [ayvens.it] INFO: Extracting data for car ID: 1988850
2026-03-27 16:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97276624-8541-564d-ac98-0ddc817904ac with identifier: 1988850
2026-03-27 16:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97276624-8541-564d-ac98-0ddc817904ac with scrape type 1
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/1.jpg not downloaded yet
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/2.jpg not downloaded yet
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69047d50>
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/3.jpg saved to cache
2026-03-27 16:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acfb10>
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/10.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d463d0>
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/2.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:32:06 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 1 pages/min), scraped 27 items (at 19 items/min)
2026-03-27 16:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 186MiB
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/3.jpg not downloaded yet
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccd910>
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/6.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcc750>
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/7.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d03c90>
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/5.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/4.jpg not downloaded yet
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c9ac10>
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/2.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9a210>
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/1.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/5.jpg not downloaded yet
2026-03-27 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/6.jpg not downloaded yet
2026-03-27 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/7.jpg not downloaded yet
2026-03-27 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/8.jpg not downloaded yet
2026-03-27 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/9.jpg not downloaded yet
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/10.jpg not downloaded yet
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b187d0>
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/5.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:32:06 [ayvens.it] INFO: Found listing with ID: 1988851
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988851%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [ayvens.it] INFO: Scrape type for 1988851: 1
2026-03-27 16:32:06 [ayvens.it] INFO: Extracting data for car ID: 1988851
2026-03-27 16:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011 with identifier: 1988851
2026-03-27 16:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011 with scrape type 1
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/1.jpg not downloaded yet
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4b810>
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/6.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68483e50>
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/8.jpg saved to cache
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/2.jpg not downloaded yet
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/3.jpg not downloaded yet
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d34a90>
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/9.jpg saved to cache
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922d190>
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/10.jpg saved to cache
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922cf90>
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/3.jpg saved to cache
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad11390>
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/2.jpg saved to cache
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba2e90>
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/1.jpg saved to cache
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/4.jpg not downloaded yet
2026-03-27 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/5.jpg not downloaded yet
2026-03-27 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/6.jpg not downloaded yet
2026-03-27 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/7.jpg not downloaded yet
2026-03-27 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/8.jpg not downloaded yet
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/9.jpg not downloaded yet
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/10.jpg not downloaded yet
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0e890>
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/7.jpg saved to cache
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e6010>
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/7.jpg saved to cache
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:32:07 [ayvens.it] INFO: Found listing with ID: 1988852
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988852%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [ayvens.it] INFO: Scrape type for 1988852: 1
2026-03-27 16:32:07 [ayvens.it] INFO: Extracting data for car ID: 1988852
2026-03-27 16:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099 with identifier: 1988852
2026-03-27 16:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099 with scrape type 1
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/1.jpg not downloaded yet
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bd8110>
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/6.jpg saved to cache
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b676d0>
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/5.jpg saved to cache
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/2.jpg not downloaded yet
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/3.jpg not downloaded yet
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c79a50>
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/4.jpg saved to cache
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914e450>
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/3.jpg saved to cache
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd5a90>
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/2.jpg saved to cache
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694db250>
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/1.jpg saved to cache
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/4.jpg not downloaded yet
2026-03-27 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/5.jpg not downloaded yet
2026-03-27 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/6.jpg not downloaded yet
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/7.jpg not downloaded yet
2026-03-27 16:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/8.jpg not downloaded yet
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/9.jpg not downloaded yet
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/10.jpg not downloaded yet
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1e450>
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/10.jpg saved to cache
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba30d0>
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/8.jpg saved to cache
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:08 [ayvens.it] INFO: Found listing with ID: 1988853
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988853%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [ayvens.it] INFO: Scrape type for 1988853: 1
2026-03-27 16:32:08 [ayvens.it] INFO: Extracting data for car ID: 1988853
2026-03-27 16:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80 with identifier: 1988853
2026-03-27 16:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80 with scrape type 1
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/1.jpg not downloaded yet
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b3de10>
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F9efc27b25adf4664adbe3e0bbf667b9c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/9.jpg saved to cache
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5
2026-03-27 16:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22386387-ccf1-50fb-a45c-eb30dbc4b4a5, skipping ID generation
2026-03-27 16:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5 with scrape type 1
2026-03-27 16:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22386387-ccf1-50fb-a45c-eb30dbc4b4a5 sending to next pipeline
2026-03-27 16:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 22386387-ccf1-50fb-a45c-eb30dbc4b4a5, identifier: 1988849
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f9c90>
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/1.jpg saved to cache
2026-03-27 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922f410>
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/4.jpg saved to cache
2026-03-27 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68adccd0>
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/6.jpg saved to cache
2026-03-27 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/2.jpg not downloaded yet
2026-03-27 16:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 22386387-ccf1-50fb-a45c-eb30dbc4b4a5 with identifier: 1988849
2026-03-27 16:32:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 22386387-ccf1-50fb-a45c-eb30dbc4b4a5 with identifier: 1988849
2026-03-27 16:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 22386387-ccf1-50fb-a45c-eb30dbc4b4a5 with identifier: 1988849 to the API
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Dolphin Grey Metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '22386387-ccf1-50fb-a45c-eb30dbc4b4a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 2.0 TDI SCR 85kW Style Hatchback 5-door (Euro 6D)',
'odometer': 222644,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 798494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 801718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 565120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548952,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22386387-ccf1-50fb-a45c-eb30dbc4b4a5/22386387-ccf1-50fb-a45c-eb30dbc4b4a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/9efc27b25adf4664adbe3e0bbf667b9c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 2.0 TDI SCR 85kW Style Hatchback 5-door '
'(Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988849%27 HTTP/1.1" 200 None
2026-03-27 16:32:09 [ayvens.it] INFO: Saving data for 1988849: {'created_time': 1774629129.855757, 'last_price_update_time': 1774629129.855769, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988849') HTTP/1.1" 204 0
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/3.jpg not downloaded yet
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6add49d0>
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/7.jpg saved to cache
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc5b10>
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/5.jpg saved to cache
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/4.jpg not downloaded yet
2026-03-27 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/5.jpg not downloaded yet
2026-03-27 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/6.jpg not downloaded yet
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/7.jpg not downloaded yet
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/8.jpg not downloaded yet
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/9.jpg not downloaded yet
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936a9d0>
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/8.jpg saved to cache
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/10.jpg not downloaded yet
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b73910>
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/4.jpg saved to cache
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecc890>
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/10.jpg saved to cache
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68523310>
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/2.jpg saved to cache
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b227890>
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/9.jpg saved to cache
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:10 [ayvens.it] INFO: Found listing with ID: 1988854
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988854%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [ayvens.it] INFO: Scrape type for 1988854: 1
2026-03-27 16:32:10 [ayvens.it] INFO: Extracting data for car ID: 1988854
2026-03-27 16:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d50ee168-81db-55af-9d97-40f36811d509 with identifier: 1988854
2026-03-27 16:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d50ee168-81db-55af-9d97-40f36811d509 with scrape type 1
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/1.jpg not downloaded yet
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/2.jpg not downloaded yet
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68609850>
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/3.jpg saved to cache
2026-03-27 16:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b89a90>
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/5.jpg saved to cache
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e4bd0>
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/1.jpg saved to cache
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/3.jpg not downloaded yet
2026-03-27 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/4.jpg not downloaded yet
2026-03-27 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/5.jpg not downloaded yet
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/6.jpg not downloaded yet
2026-03-27 16:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/7.jpg not downloaded yet
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/8.jpg not downloaded yet
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/9.jpg not downloaded yet
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6bb90>
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/6.jpg saved to cache
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68605990>
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/10.jpg saved to cache
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/10.jpg not downloaded yet
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684fab10>
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/4.jpg saved to cache
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b33550>
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7c18b49a78584add99592aad351be7d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/7.jpg saved to cache
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011
2026-03-27 16:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011, skipping ID generation
2026-03-27 16:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011 with scrape type 1
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011 sending to next pipeline
2026-03-27 16:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011, identifier: 1988851
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcc950>
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/5.jpg saved to cache
2026-03-27 16:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936a810>
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/2.jpg saved to cache
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69072810>
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/3.jpg saved to cache
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:12 [ayvens.it] INFO: Found listing with ID: 1988855
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988855%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [ayvens.it] INFO: Scrape type for 1988855: 1
2026-03-27 16:32:12 [ayvens.it] INFO: Extracting data for car ID: 1988855
2026-03-27 16:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c314dd78-7967-51e2-aada-a125231d4c28 with identifier: 1988855
2026-03-27 16:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c314dd78-7967-51e2-aada-a125231d4c28 with scrape type 1
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/1.jpg not downloaded yet
2026-03-27 16:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011 with identifier: 1988851
2026-03-27 16:32:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011 with identifier: 1988851
2026-03-27 16:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 802fc5a5-897b-5e27-b9c3-dd7a5a5b6011 with identifier: 1988851 to the API
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Argento Floret metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '802fc5a5-897b-5e27-b9c3-dd7a5a5b6011',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 35 TDI Business S tronic Sport utility vehicle 5-door (Euro '
'6D) mild hybrid',
'odometer': 123035,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587840,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566174,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587840,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408771,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_802fc5a5-897b-5e27-b9c3-dd7a5a5b6011/802fc5a5-897b-5e27-b9c3-dd7a5a5b6011_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493382,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7c18b49a78584add99592aad351be7d8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-03',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 35 TDI Business S tronic Sport utility vehicle 5-door '
'(Euro 6D) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988851%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [ayvens.it] INFO: Saving data for 1988851: {'created_time': 1774629132.592995, 'last_price_update_time': 1774629132.593005, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988851') HTTP/1.1" 204 0
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/2.jpg not downloaded yet
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693559d0>
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/1.jpg saved to cache
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/3.jpg not downloaded yet
2026-03-27 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/4.jpg not downloaded yet
2026-03-27 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/5.jpg not downloaded yet
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/6.jpg not downloaded yet
2026-03-27 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/7.jpg not downloaded yet
2026-03-27 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/8.jpg not downloaded yet
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/9.jpg not downloaded yet
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ace290>
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/10.jpg saved to cache
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/10.jpg not downloaded yet
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b4310>
2026-03-27 16:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/7.jpg saved to cache
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5ded0>
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/8.jpg saved to cache
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acea50>
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/9.jpg saved to cache
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:32:13 [ayvens.it] INFO: Found listing with ID: 1988856
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988856%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [ayvens.it] INFO: Scrape type for 1988856: 1
2026-03-27 16:32:13 [ayvens.it] INFO: Extracting data for car ID: 1988856
2026-03-27 16:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d383a6f-92e1-55bc-aa7a-a539013dba2f with identifier: 1988856
2026-03-27 16:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f with scrape type 1
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/1.jpg not downloaded yet
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/2.jpg not downloaded yet
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a68810>
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/4.jpg saved to cache
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7ca10>
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/3.jpg saved to cache
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f12d0>
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/5.jpg saved to cache
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4be50>
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/2.jpg saved to cache
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/3.jpg not downloaded yet
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/4.jpg not downloaded yet
2026-03-27 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/5.jpg not downloaded yet
2026-03-27 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/6.jpg not downloaded yet
2026-03-27 16:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/7.jpg not downloaded yet
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/8.jpg not downloaded yet
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/9.jpg not downloaded yet
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/10.jpg not downloaded yet
2026-03-27 16:32:13 [ayvens.it] INFO: Found listing with ID: 1988857
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988857%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [ayvens.it] INFO: Scrape type for 1988857: 1
2026-03-27 16:32:13 [ayvens.it] INFO: Extracting data for car ID: 1988857
2026-03-27 16:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f730eb4-842c-5988-bf25-8255e3ff6545 with identifier: 1988857
2026-03-27 16:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f730eb4-842c-5988-bf25-8255e3ff6545 with scrape type 1
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/1.jpg not downloaded yet
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b65d0>
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/4.jpg saved to cache
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c98d10>
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/10.jpg saved to cache
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b55610>
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/2.jpg saved to cache
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69044810>
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/3.jpg saved to cache
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/2.jpg not downloaded yet
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c68c90>
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/8.jpg saved to cache
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853e090>
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/10.jpg saved to cache
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ef590>
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/1.jpg saved to cache
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d91d0>
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/9.jpg saved to cache
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/3.jpg not downloaded yet
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/4.jpg not downloaded yet
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/5.jpg not downloaded yet
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/6.jpg not downloaded yet
2026-03-27 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/7.jpg not downloaded yet
2026-03-27 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/8.jpg not downloaded yet
2026-03-27 16:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/9.jpg not downloaded yet
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/10.jpg not downloaded yet
2026-03-27 16:32:14 [ayvens.it] INFO: Found listing with ID: 1988858
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988858%27 HTTP/1.1" 200 None
2026-03-27 16:32:14 [ayvens.it] INFO: Scrape type for 1988858: 1
2026-03-27 16:32:14 [ayvens.it] INFO: Extracting data for car ID: 1988858
2026-03-27 16:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 544cea6d-c67e-5a30-91cf-5a32d6330c30 with identifier: 1988858
2026-03-27 16:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 544cea6d-c67e-5a30-91cf-5a32d6330c30 with scrape type 1
2026-03-27 16:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/1.jpg not downloaded yet
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/2.jpg not downloaded yet
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853e690>
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/1.jpg saved to cache
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912c510>
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/10.jpg saved to cache
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d209d0>
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/8.jpg saved to cache
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d22c50>
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/4.jpg saved to cache
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69326d50>
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/9.jpg saved to cache
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c09490>
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/1.jpg saved to cache
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912f510>
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/2.jpg saved to cache
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d23d10>
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/3.jpg saved to cache
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/3.jpg not downloaded yet
2026-03-27 16:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/4.jpg not downloaded yet
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/5.jpg not downloaded yet
2026-03-27 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/6.jpg not downloaded yet
2026-03-27 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/7.jpg not downloaded yet
2026-03-27 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/8.jpg not downloaded yet
2026-03-27 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/9.jpg not downloaded yet
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/10.jpg not downloaded yet
2026-03-27 16:32:16 [ayvens.it] INFO: Found listing with ID: 1988859
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988859%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [ayvens.it] INFO: Scrape type for 1988859: 1
2026-03-27 16:32:16 [ayvens.it] INFO: Extracting data for car ID: 1988859
2026-03-27 16:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d52ba4-cc90-55b0-a898-75af5a4f3ba5 with identifier: 1988859
2026-03-27 16:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5 with scrape type 1
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/1.jpg not downloaded yet
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692dcad0>
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/4.jpg saved to cache
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/2.jpg not downloaded yet
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5ced0>
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/7.jpg saved to cache
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b48450>
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/6.jpg saved to cache
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d23810>
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/2.jpg saved to cache
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69140510>
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/3.jpg saved to cache
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b55dd0>
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/5.jpg saved to cache
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/3.jpg not downloaded yet
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/4.jpg not downloaded yet
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69029b90>
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf4%252Faed6e4b5a1fc420e86fbe696a9f585e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/5.jpg saved to cache
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c314dd78-7967-51e2-aada-a125231d4c28
2026-03-27 16:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c314dd78-7967-51e2-aada-a125231d4c28, skipping ID generation
2026-03-27 16:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c314dd78-7967-51e2-aada-a125231d4c28 with scrape type 1
2026-03-27 16:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c314dd78-7967-51e2-aada-a125231d4c28 sending to next pipeline
2026-03-27 16:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c314dd78-7967-51e2-aada-a125231d4c28, identifier: 1988855
2026-03-27 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691411d0>
2026-03-27 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/2.jpg saved to cache
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c314dd78-7967-51e2-aada-a125231d4c28 with identifier: 1988855
2026-03-27 16:32:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c314dd78-7967-51e2-aada-a125231d4c28 with identifier: 1988855
2026-03-27 16:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c314dd78-7967-51e2-aada-a125231d4c28 with identifier: 1988855 to the API
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO URANO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'c314dd78-7967-51e2-aada-a125231d4c28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Life DSG Hatchback 5-door '
'(Euro 6.2) mild hybrid',
'odometer': 123839,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 860303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 860303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 795324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 842496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666985,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c314dd78-7967-51e2-aada-a125231d4c28/c314dd78-7967-51e2-aada-a125231d4c28_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675058,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf4/aed6e4b5a1fc420e86fbe696a9f585e6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-03',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Life DSG Hatchback '
'5-door (Euro 6.2) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988855%27 HTTP/1.1" 200 None
2026-03-27 16:32:17 [ayvens.it] INFO: Saving data for 1988855: {'created_time': 1774629137.757109, 'last_price_update_time': 1774629137.75712, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988855') HTTP/1.1" 204 0
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/5.jpg not downloaded yet
2026-03-27 16:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/6.jpg not downloaded yet
2026-03-27 16:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/7.jpg not downloaded yet
2026-03-27 16:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/8.jpg not downloaded yet
2026-03-27 16:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/9.jpg not downloaded yet
2026-03-27 16:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/10.jpg not downloaded yet
2026-03-27 16:32:17 [ayvens.it] INFO: Found listing with ID: 1988860
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988860%27 HTTP/1.1" 200 None
2026-03-27 16:32:17 [ayvens.it] INFO: Scrape type for 1988860: 1
2026-03-27 16:32:17 [ayvens.it] INFO: Extracting data for car ID: 1988860
2026-03-27 16:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14759551-997f-5ac9-ae3f-50d9e50ca3e4 with identifier: 1988860
2026-03-27 16:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4 with scrape type 1
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/1.jpg not downloaded yet
2026-03-27 16:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af7310>
2026-03-27 16:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/1.jpg saved to cache
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/2.jpg not downloaded yet
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914d5d0>
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/6.jpg saved to cache
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acfe50>
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/3.jpg saved to cache
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa26510>
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/5.jpg saved to cache
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922d150>
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/2.jpg saved to cache
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/3.jpg not downloaded yet
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/4.jpg not downloaded yet
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb7090>
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/4.jpg saved to cache
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b1ac50>
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/1.jpg saved to cache
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69073050>
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/3.jpg saved to cache
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/5.jpg not downloaded yet
2026-03-27 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/6.jpg not downloaded yet
2026-03-27 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/7.jpg not downloaded yet
2026-03-27 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/8.jpg not downloaded yet
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/9.jpg not downloaded yet
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/10.jpg not downloaded yet
2026-03-27 16:32:18 [ayvens.it] INFO: Found listing with ID: 1988861
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988861%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [ayvens.it] INFO: Scrape type for 1988861: 1
2026-03-27 16:32:18 [ayvens.it] INFO: Extracting data for car ID: 1988861
2026-03-27 16:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe886092-3a49-501a-822a-0c61bef51008 with identifier: 1988861
2026-03-27 16:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe886092-3a49-501a-822a-0c61bef51008 with scrape type 1
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/1.jpg not downloaded yet
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d472d0>
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/3.jpg saved to cache
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ece950>
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/2.jpg saved to cache
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7fc10>
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/10.jpg saved to cache
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/2.jpg not downloaded yet
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68543150>
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/8.jpg saved to cache
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b73750>
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/6.jpg saved to cache
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/3.jpg not downloaded yet
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/4.jpg not downloaded yet
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b71690>
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/5.jpg saved to cache
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5e250>
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/4.jpg saved to cache
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc99d0>
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/9.jpg saved to cache
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/5.jpg not downloaded yet
2026-03-27 16:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/6.jpg not downloaded yet
2026-03-27 16:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/7.jpg not downloaded yet
2026-03-27 16:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/8.jpg not downloaded yet
2026-03-27 16:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/9.jpg not downloaded yet
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/10.jpg not downloaded yet
2026-03-27 16:32:19 [ayvens.it] INFO: Found listing with ID: 1988862
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988862%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [ayvens.it] INFO: Scrape type for 1988862: 1
2026-03-27 16:32:19 [ayvens.it] INFO: Extracting data for car ID: 1988862
2026-03-27 16:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4c993cd-c1f7-5e2f-a945-0ea3d61043df with identifier: 1988862
2026-03-27 16:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df with scrape type 1
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/1.jpg not downloaded yet
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b73950>
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/6.jpg saved to cache
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916d1d0>
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/7.jpg saved to cache
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd6ad0>
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/5.jpg saved to cache
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/2.jpg not downloaded yet
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b64e50>
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/1.jpg saved to cache
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68522e50>
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/3.jpg saved to cache
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3ffd0>
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/4.jpg saved to cache
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e5850>
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/2.jpg saved to cache
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/3.jpg not downloaded yet
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/4.jpg not downloaded yet
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69235610>
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/1.jpg saved to cache
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/5.jpg not downloaded yet
2026-03-27 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/6.jpg not downloaded yet
2026-03-27 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/7.jpg not downloaded yet
2026-03-27 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/8.jpg not downloaded yet
2026-03-27 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/9.jpg not downloaded yet
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/10.jpg not downloaded yet
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835e390>
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/10.jpg saved to cache
2026-03-27 16:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:20 [ayvens.it] INFO: Found listing with ID: 1988863
2026-03-27 16:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988863%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [ayvens.it] INFO: Scrape type for 1988863: 1
2026-03-27 16:32:21 [ayvens.it] INFO: Extracting data for car ID: 1988863
2026-03-27 16:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329 with identifier: 1988863
2026-03-27 16:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329 with scrape type 1
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/1.jpg not downloaded yet
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914e010>
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/9.jpg saved to cache
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c87dd0>
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/5.jpg saved to cache
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/2.jpg not downloaded yet
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/3.jpg not downloaded yet
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928fb90>
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/10.jpg saved to cache
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6921cc10>
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/4.jpg saved to cache
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f1450>
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/2.jpg saved to cache
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3fc10>
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/1.jpg saved to cache
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692de190>
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/6.jpg saved to cache
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/4.jpg not downloaded yet
2026-03-27 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/5.jpg not downloaded yet
2026-03-27 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/6.jpg not downloaded yet
2026-03-27 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/7.jpg not downloaded yet
2026-03-27 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/8.jpg not downloaded yet
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/9.jpg not downloaded yet
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/10.jpg not downloaded yet
2026-03-27 16:32:21 [ayvens.it] INFO: Found listing with ID: 1988864
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988864%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [ayvens.it] INFO: Scrape type for 1988864: 1
2026-03-27 16:32:21 [ayvens.it] INFO: Extracting data for car ID: 1988864
2026-03-27 16:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06839c81-a442-5623-9b90-3959e3b63795 with identifier: 1988864
2026-03-27 16:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06839c81-a442-5623-9b90-3959e3b63795 with scrape type 1
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/1.jpg not downloaded yet
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c36fd0>
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/7.jpg saved to cache
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/2.jpg not downloaded yet
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900a390>
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/8.jpg saved to cache
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a59050>
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/3.jpg saved to cache
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6921d550>
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/5.jpg saved to cache
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69326010>
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/9.jpg saved to cache
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c34150>
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/2.jpg saved to cache
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/3.jpg not downloaded yet
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/4.jpg not downloaded yet
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3c6d0>
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/6.jpg saved to cache
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1efd0>
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/4.jpg saved to cache
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/5.jpg not downloaded yet
2026-03-27 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/6.jpg not downloaded yet
2026-03-27 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/7.jpg not downloaded yet
2026-03-27 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/8.jpg not downloaded yet
2026-03-27 16:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/9.jpg not downloaded yet
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/10.jpg not downloaded yet
2026-03-27 16:32:22 [ayvens.it] INFO: Found listing with ID: 1988865
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988865%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [ayvens.it] INFO: Scrape type for 1988865: 1
2026-03-27 16:32:22 [ayvens.it] INFO: Extracting data for car ID: 1988865
2026-03-27 16:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a8c9e97-1864-5d57-92de-e1f2020540cf with identifier: 1988865
2026-03-27 16:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a8c9e97-1864-5d57-92de-e1f2020540cf with scrape type 1
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a8c9e97-1864-5d57-92de-e1f2020540cf
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/1.jpg not downloaded yet
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/2.jpg not downloaded yet
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c98590>
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/2.jpg saved to cache
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fed450>
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/4.jpg saved to cache
2026-03-27 16:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc7ad0>
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/5.jpg saved to cache
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fec610>
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/3.jpg saved to cache
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/3.jpg not downloaded yet
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923c550>
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/7.jpg saved to cache
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690900d0>
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/1.jpg saved to cache
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922f050>
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/6.jpg saved to cache
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/4.jpg not downloaded yet
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/5.jpg not downloaded yet
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690d10d0>
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/10.jpg saved to cache
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/6.jpg not downloaded yet
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/7.jpg not downloaded yet
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69303f50>
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/5.jpg saved to cache
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acc210>
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/3.jpg saved to cache
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/8.jpg not downloaded yet
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/9.jpg not downloaded yet
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/10.jpg not downloaded yet
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68543c50>
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/10.jpg saved to cache
2026-03-27 16:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc8150>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/1.jpg saved to cache
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693278d0>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/2.jpg saved to cache
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:24 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:24 [ayvens.it] INFO: Found listing with ID: 1988866
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988866%27 HTTP/1.1" 200 None
2026-03-27 16:32:24 [ayvens.it] INFO: Scrape type for 1988866: 1
2026-03-27 16:32:24 [ayvens.it] INFO: Extracting data for car ID: 1988866
2026-03-27 16:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cc530df-dc6c-55ed-8d65-7c29df268c35 with identifier: 1988866
2026-03-27 16:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cc530df-dc6c-55ed-8d65-7c29df268c35 with scrape type 1
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/1.jpg not downloaded yet
2026-03-27 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/2.jpg not downloaded yet
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b73810>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/3.jpg saved to cache
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3f3d0>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/4.jpg saved to cache
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf due to Ignoring non-200 response
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad12f10>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/1.jpg saved to cache
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691437d0>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/5.jpg saved to cache
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69019810>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/4.jpg saved to cache
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/3.jpg not downloaded yet
2026-03-27 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/4.jpg not downloaded yet
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/5.jpg not downloaded yet
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf due to Ignoring non-200 response
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f7950>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/9.jpg saved to cache
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:24 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/6.jpg not downloaded yet
2026-03-27 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/7.jpg not downloaded yet
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d10290>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/9.jpg saved to cache
2026-03-27 16:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feebd0>
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/6.jpg saved to cache
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/8.jpg not downloaded yet
2026-03-27 16:32:25 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/9.jpg not downloaded yet
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/10.jpg not downloaded yet
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68521450>
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/1.jpg saved to cache
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf due to Ignoring non-200 response
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3d990>
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/8.jpg saved to cache
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69142710>
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/10.jpg saved to cache
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfcd90>
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/4.jpg saved to cache
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf
2026-03-27 16:32:25 [ayvens.it] INFO: Found listing with ID: 1988867
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988867%27 HTTP/1.1" 200 None
2026-03-27 16:32:25 [ayvens.it] INFO: Scrape type for 1988867: 1
2026-03-27 16:32:25 [ayvens.it] INFO: Extracting data for car ID: 1988867
2026-03-27 16:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5acd07ac-7f64-5961-a57a-cc9b46fead3f with identifier: 1988867
2026-03-27 16:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f with scrape type 1
2026-03-27 16:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/1.jpg not downloaded yet
2026-03-27 16:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/2.jpg not downloaded yet
2026-03-27 16:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0ee10>
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/5.jpg saved to cache
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf due to Ignoring non-200 response
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68544a10>
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252F7b036de8cb4e46d8b470ff08e43a1f05%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/7.jpg saved to cache
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06839c81-a442-5623-9b90-3959e3b63795
2026-03-27 16:32:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06839c81-a442-5623-9b90-3959e3b63795, skipping ID generation
2026-03-27 16:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06839c81-a442-5623-9b90-3959e3b63795 with scrape type 1
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06839c81-a442-5623-9b90-3959e3b63795 sending to next pipeline
2026-03-27 16:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 06839c81-a442-5623-9b90-3959e3b63795, identifier: 1988864
2026-03-27 16:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/3.jpg not downloaded yet
2026-03-27 16:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 06839c81-a442-5623-9b90-3959e3b63795 with identifier: 1988864
2026-03-27 16:32:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 06839c81-a442-5623-9b90-3959e3b63795 with identifier: 1988864
2026-03-27 16:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 06839c81-a442-5623-9b90-3959e3b63795 with identifier: 1988864 to the API
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '06839c81-a442-5623-9b90-3959e3b63795',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT CONNECT 1.5 TDCi 100cv S&S Trend 210 L2H1 Vettura '
'Furgonata 4-door (Euro 6.2)',
'odometer': 113094,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 737442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506436,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614680,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557575,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460548,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300821,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06839c81-a442-5623-9b90-3959e3b63795/06839c81-a442-5623-9b90-3959e3b63795_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 832376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/7b036de8cb4e46d8b470ff08e43a1f05/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT CONNECT 1.5 TDCi 100cv S&S Trend 210 L2H1 Vettura '
'Furgonata 4-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988864%27 HTTP/1.1" 200 None
2026-03-27 16:32:26 [ayvens.it] INFO: Saving data for 1988864: {'created_time': 1774629146.687407, 'last_price_update_time': 1774629146.687417, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988864') HTTP/1.1" 204 0
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/4.jpg not downloaded yet
2026-03-27 16:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/5.jpg not downloaded yet
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f99f10>
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/9.jpg saved to cache
2026-03-27 16:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1c650>
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/6.jpg saved to cache
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3d1d0>
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/8.jpg saved to cache
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b81cd0>
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/3.jpg saved to cache
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6a590>
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/7.jpg saved to cache
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/6.jpg not downloaded yet
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/7.jpg not downloaded yet
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1fb10>
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252F758a6f8232d4490bb18e1b82dddd743a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/10.jpg saved to cache
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a8c9e97-1864-5d57-92de-e1f2020540cf
2026-03-27 16:32:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a8c9e97-1864-5d57-92de-e1f2020540cf, skipping ID generation
2026-03-27 16:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a8c9e97-1864-5d57-92de-e1f2020540cf with scrape type 1
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a8c9e97-1864-5d57-92de-e1f2020540cf sending to next pipeline
2026-03-27 16:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8a8c9e97-1864-5d57-92de-e1f2020540cf, identifier: 1988865
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef6510>
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/2.jpg saved to cache
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/8.jpg not downloaded yet
2026-03-27 16:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8a8c9e97-1864-5d57-92de-e1f2020540cf with identifier: 1988865
2026-03-27 16:32:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8a8c9e97-1864-5d57-92de-e1f2020540cf with identifier: 1988865
2026-03-27 16:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8a8c9e97-1864-5d57-92de-e1f2020540cf with identifier: 1988865 to the API
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero Tulipano perlato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '8a8c9e97-1864-5d57-92de-e1f2020540cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KODIAQ 2.0 TDI 110KW EXECUTIVE DSG 5p Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 196573,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649851,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649851,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623187,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523221,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513187,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8c9e97-1864-5d57-92de-e1f2020540cf/8a8c9e97-1864-5d57-92de-e1f2020540cf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/758a6f8232d4490bb18e1b82dddd743a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KODIAQ 2.0 TDI 110KW EXECUTIVE DSG 5p Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988865%27 HTTP/1.1" 200 None
2026-03-27 16:32:27 [ayvens.it] INFO: Saving data for 1988865: {'created_time': 1774629147.919591, 'last_price_update_time': 1774629147.919604, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988865') HTTP/1.1" 204 0
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/9.jpg not downloaded yet
2026-03-27 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/10.jpg not downloaded yet
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2c050>
2026-03-27 16:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/1.jpg saved to cache
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b80310>
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/5.jpg saved to cache
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d12b90>
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/4.jpg saved to cache
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c85a10>
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/6.jpg saved to cache
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68608550>
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252Fb3b733e93d6741efac37f10d6e9562d3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/6.jpg saved to cache
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329
2026-03-27 16:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329, skipping ID generation
2026-03-27 16:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329 with scrape type 1
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329 sending to next pipeline
2026-03-27 16:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329, identifier: 1988863
2026-03-27 16:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329 with identifier: 1988863
2026-03-27 16:32:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329 with identifier: 1988863
2026-03-27 16:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 47ef05ee-a8fa-508f-a7fe-8e7b3cc67329 with identifier: 1988863 to the API
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO CHRONOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '47ef05ee-a8fa-508f-a7fe-8e7b3cc67329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 45 TFSI E S TRONIC FP',
'odometer': 90503,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311369,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373539,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ef05ee-a8fa-508f-a7fe-8e7b3cc67329/47ef05ee-a8fa-508f-a7fe-8e7b3cc67329_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389016,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/b3b733e93d6741efac37f10d6e9562d3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-03',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 45 TFSI E S TRONIC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988863%27 HTTP/1.1" 200 None
2026-03-27 16:32:28 [ayvens.it] INFO: Saving data for 1988863: {'created_time': 1774629148.845095, 'last_price_update_time': 1774629148.845109, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988863') HTTP/1.1" 204 0
2026-03-27 16:32:28 [ayvens.it] INFO: Found listing with ID: 1988868
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988868%27 HTTP/1.1" 200 None
2026-03-27 16:32:28 [ayvens.it] INFO: Scrape type for 1988868: 1
2026-03-27 16:32:28 [ayvens.it] INFO: Extracting data for car ID: 1988868
2026-03-27 16:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04071609-5057-5dc6-96a3-8c1593d9087c with identifier: 1988868
2026-03-27 16:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04071609-5057-5dc6-96a3-8c1593d9087c with scrape type 1
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/1.jpg not downloaded yet
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/2.jpg not downloaded yet
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3f2d0>
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/10.jpg saved to cache
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d02e10>
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/10.jpg saved to cache
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923e3d0>
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/7.jpg saved to cache
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/3.jpg not downloaded yet
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/4.jpg not downloaded yet
2026-03-27 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/5.jpg not downloaded yet
2026-03-27 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/6.jpg not downloaded yet
2026-03-27 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/7.jpg not downloaded yet
2026-03-27 16:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/8.jpg not downloaded yet
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/9.jpg not downloaded yet
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d01c90>
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/8.jpg saved to cache
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68beff50>
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/9.jpg saved to cache
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/10.jpg not downloaded yet
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69008510>
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/1.jpg saved to cache
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:29 [ayvens.it] INFO: Found listing with ID: 1988869
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988869%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [ayvens.it] INFO: Scrape type for 1988869: 1
2026-03-27 16:32:29 [ayvens.it] INFO: Extracting data for car ID: 1988869
2026-03-27 16:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8750ff9-b61d-5ee7-a525-6021f9ae3790 with identifier: 1988869
2026-03-27 16:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8750ff9-b61d-5ee7-a525-6021f9ae3790 with scrape type 1
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/1.jpg not downloaded yet
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/2.jpg not downloaded yet
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c57e50>
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F62eaa46e1d6844d9aab20ac232b0a2ad%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/9.jpg saved to cache
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cc530df-dc6c-55ed-8d65-7c29df268c35
2026-03-27 16:32:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cc530df-dc6c-55ed-8d65-7c29df268c35, skipping ID generation
2026-03-27 16:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cc530df-dc6c-55ed-8d65-7c29df268c35 with scrape type 1
2026-03-27 16:32:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cc530df-dc6c-55ed-8d65-7c29df268c35 sending to next pipeline
2026-03-27 16:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6cc530df-dc6c-55ed-8d65-7c29df268c35, identifier: 1988866
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e698e8810>
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/2.jpg saved to cache
2026-03-27 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e4510>
2026-03-27 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj8%252F44102051f28a4b5da8b65f1ed6f8fa24%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/8.jpg saved to cache
2026-03-27 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df
2026-03-27 16:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4c993cd-c1f7-5e2f-a945-0ea3d61043df, skipping ID generation
2026-03-27 16:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df with scrape type 1
2026-03-27 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4c993cd-c1f7-5e2f-a945-0ea3d61043df sending to next pipeline
2026-03-27 16:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c4c993cd-c1f7-5e2f-a945-0ea3d61043df, identifier: 1988862
2026-03-27 16:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0f190>
2026-03-27 16:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/3.jpg saved to cache
2026-03-27 16:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6cc530df-dc6c-55ed-8d65-7c29df268c35 with identifier: 1988866
2026-03-27 16:32:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6cc530df-dc6c-55ed-8d65-7c29df268c35 with identifier: 1988866
2026-03-27 16:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6cc530df-dc6c-55ed-8d65-7c29df268c35 with identifier: 1988866 to the API
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '6cc530df-dc6c-55ed-8d65-7c29df268c35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MITSUBISHI',
'model': 'MITSUBISHI SPACE STAR 1.2 INTENSE SDA FP',
'odometer': 81760,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551788,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283387,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589706,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc530df-dc6c-55ed-8d65-7c29df268c35/6cc530df-dc6c-55ed-8d65-7c29df268c35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245080,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/62eaa46e1d6844d9aab20ac232b0a2ad/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'MITSUBISHI MITSUBISHI SPACE STAR 1.2 INTENSE SDA FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988866%27 HTTP/1.1" 200 None
2026-03-27 16:32:30 [ayvens.it] INFO: Saving data for 1988866: {'created_time': 1774629150.709653, 'last_price_update_time': 1774629150.709663, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988866') HTTP/1.1" 204 0
2026-03-27 16:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c4c993cd-c1f7-5e2f-a945-0ea3d61043df with identifier: 1988862
2026-03-27 16:32:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c4c993cd-c1f7-5e2f-a945-0ea3d61043df with identifier: 1988862
2026-03-27 16:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c4c993cd-c1f7-5e2f-a945-0ea3d61043df with identifier: 1988862 to the API
2026-03-27 16:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Magnetic Grey metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'c4c993cd-c1f7-5e2f-a945-0ea3d61043df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 EcoBlue 120CV 2WD Connect Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 145433,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4c993cd-c1f7-5e2f-a945-0ea3d61043df/c4c993cd-c1f7-5e2f-a945-0ea3d61043df_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj8/44102051f28a4b5da8b65f1ed6f8fa24/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 EcoBlue 120CV 2WD Connect Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988862%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [ayvens.it] INFO: Saving data for 1988862: {'created_time': 1774629151.143389, 'last_price_update_time': 1774629151.143402, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988862') HTTP/1.1" 204 0
2026-03-27 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/3.jpg not downloaded yet
2026-03-27 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/4.jpg not downloaded yet
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b1ab9d0>
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/5.jpg saved to cache
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/5.jpg not downloaded yet
2026-03-27 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/6.jpg not downloaded yet
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916ee50>
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/4.jpg saved to cache
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfe510>
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/6.jpg saved to cache
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/7.jpg not downloaded yet
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/8.jpg not downloaded yet
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b79d0>
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/7.jpg saved to cache
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f7e90>
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/9.jpg saved to cache
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0cdd0>
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/8.jpg saved to cache
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2e90>
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/9.jpg saved to cache
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/9.jpg not downloaded yet
2026-03-27 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/10.jpg not downloaded yet
2026-03-27 16:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:31 [ayvens.it] INFO: Found listing with ID: 1988870
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988870%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [ayvens.it] INFO: Scrape type for 1988870: 1
2026-03-27 16:32:31 [ayvens.it] INFO: Extracting data for car ID: 1988870
2026-03-27 16:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80d7785-9f42-51ea-960e-5d3de1ff2a17 with identifier: 1988870
2026-03-27 16:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80d7785-9f42-51ea-960e-5d3de1ff2a17 with scrape type 1
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/1.jpg not downloaded yet
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691402d0>
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F0ad86d05baad4de5932a7795d75bcda7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/8.jpg saved to cache
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe886092-3a49-501a-822a-0c61bef51008
2026-03-27 16:32:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe886092-3a49-501a-822a-0c61bef51008, skipping ID generation
2026-03-27 16:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe886092-3a49-501a-822a-0c61bef51008 with scrape type 1
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe886092-3a49-501a-822a-0c61bef51008 sending to next pipeline
2026-03-27 16:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fe886092-3a49-501a-822a-0c61bef51008, identifier: 1988861
2026-03-27 16:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fe886092-3a49-501a-822a-0c61bef51008 with identifier: 1988861
2026-03-27 16:32:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fe886092-3a49-501a-822a-0c61bef51008 with identifier: 1988861
2026-03-27 16:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fe886092-3a49-501a-822a-0c61bef51008 with identifier: 1988861 to the API
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MYTHOS MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'fe886092-3a49-501a-822a-0c61bef51008',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 (PC) 40 TDI BUSINESS QUATTRO S TRONIC FP',
'odometer': 159344,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 886970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655622,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 769099,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 903220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 881790,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535944,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 885102,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735867,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe886092-3a49-501a-822a-0c61bef51008/fe886092-3a49-501a-822a-0c61bef51008_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 886970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/0ad86d05baad4de5932a7795d75bcda7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-10',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 (PC) 40 TDI BUSINESS QUATTRO S TRONIC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988861%27 HTTP/1.1" 200 None
2026-03-27 16:32:32 [ayvens.it] INFO: Saving data for 1988861: {'created_time': 1774629152.537342, 'last_price_update_time': 1774629152.537352, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988861') HTTP/1.1" 204 0
2026-03-27 16:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/2.jpg not downloaded yet
2026-03-27 16:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/3.jpg not downloaded yet
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4ab90>
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/2.jpg saved to cache
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690d2a50>
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw0%252Fed8e0a76fe084c39baf7fe4addc1a6f4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/10.jpg saved to cache
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f
2026-03-27 16:32:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5acd07ac-7f64-5961-a57a-cc9b46fead3f, skipping ID generation
2026-03-27 16:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f with scrape type 1
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5acd07ac-7f64-5961-a57a-cc9b46fead3f sending to next pipeline
2026-03-27 16:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5acd07ac-7f64-5961-a57a-cc9b46fead3f, identifier: 1988867
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6af01f10>
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/4.jpg saved to cache
2026-03-27 16:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5acd07ac-7f64-5961-a57a-cc9b46fead3f with identifier: 1988867
2026-03-27 16:32:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5acd07ac-7f64-5961-a57a-cc9b46fead3f with identifier: 1988867
2026-03-27 16:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5acd07ac-7f64-5961-a57a-cc9b46fead3f with identifier: 1988867 to the API
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU NAVARRA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '5acd07ac-7f64-5961-a57a-cc9b46fead3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 35 TDI BUSINESS ADVANCED S TRONIC',
'odometer': 61172,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 815056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429476,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acd07ac-7f64-5961-a57a-cc9b46fead3f/5acd07ac-7f64-5961-a57a-cc9b46fead3f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw0/ed8e0a76fe084c39baf7fe4addc1a6f4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 35 TDI BUSINESS ADVANCED S TRONIC -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988867%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [ayvens.it] INFO: Saving data for 1988867: {'created_time': 1774629153.292426, 'last_price_update_time': 1774629153.292438, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988867') HTTP/1.1" 204 0
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/4.jpg not downloaded yet
2026-03-27 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5de10>
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/7.jpg saved to cache
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0d410>
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/6.jpg saved to cache
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c485d0>
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/1.jpg saved to cache
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c22910>
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/3.jpg saved to cache
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/5.jpg not downloaded yet
2026-03-27 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/6.jpg not downloaded yet
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d21350>
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/5.jpg saved to cache
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/7.jpg not downloaded yet
2026-03-27 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/8.jpg not downloaded yet
2026-03-27 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b66790>
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/2.jpg saved to cache
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/9.jpg not downloaded yet
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/10.jpg not downloaded yet
2026-03-27 16:32:33 [ayvens.it] INFO: Found listing with ID: 1988871
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988871%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [ayvens.it] INFO: Scrape type for 1988871: 1
2026-03-27 16:32:33 [ayvens.it] INFO: Extracting data for car ID: 1988871
2026-03-27 16:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a73218-f66c-5a83-a8ea-fa64869e0144 with identifier: 1988871
2026-03-27 16:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a73218-f66c-5a83-a8ea-fa64869e0144 with scrape type 1
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/1.jpg not downloaded yet
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68befa10>
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/10.jpg saved to cache
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68955790>
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/1.jpg saved to cache
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1ca50>
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/4.jpg saved to cache
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c34150>
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/5.jpg saved to cache
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/2.jpg not downloaded yet
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5fc10>
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/9.jpg saved to cache
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec10d0>
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/3.jpg saved to cache
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/3.jpg not downloaded yet
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/4.jpg not downloaded yet
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/5.jpg not downloaded yet
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/6.jpg not downloaded yet
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/7.jpg not downloaded yet
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/8.jpg not downloaded yet
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/9.jpg not downloaded yet
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc6b50>
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/6.jpg saved to cache
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/10.jpg not downloaded yet
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68546cd0>
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/9.jpg saved to cache
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:34 [ayvens.it] INFO: Found listing with ID: 1988872
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988872%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [ayvens.it] INFO: Scrape type for 1988872: 1
2026-03-27 16:32:34 [ayvens.it] INFO: Extracting data for car ID: 1988872
2026-03-27 16:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3409c17-3df5-500a-a99e-bb10218ccb97 with identifier: 1988872
2026-03-27 16:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3409c17-3df5-500a-a99e-bb10218ccb97 with scrape type 1
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/1.jpg not downloaded yet
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba0490>
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/10.jpg saved to cache
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0d610>
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/7.jpg saved to cache
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d8c90>
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F1edb12d4611d42779708c481b190899c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/8.jpg saved to cache
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04071609-5057-5dc6-96a3-8c1593d9087c
2026-03-27 16:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04071609-5057-5dc6-96a3-8c1593d9087c, skipping ID generation
2026-03-27 16:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04071609-5057-5dc6-96a3-8c1593d9087c with scrape type 1
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04071609-5057-5dc6-96a3-8c1593d9087c sending to next pipeline
2026-03-27 16:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 04071609-5057-5dc6-96a3-8c1593d9087c, identifier: 1988868
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6921c410>
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/2.jpg saved to cache
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c22ed0>
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/1.jpg saved to cache
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/2.jpg not downloaded yet
2026-03-27 16:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 04071609-5057-5dc6-96a3-8c1593d9087c with identifier: 1988868
2026-03-27 16:32:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 04071609-5057-5dc6-96a3-8c1593d9087c with identifier: 1988868
2026-03-27 16:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 04071609-5057-5dc6-96a3-8c1593d9087c with identifier: 1988868 to the API
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '04071609-5057-5dc6-96a3-8c1593d9087c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 308 SW (PC) SW ALLURE BLUEHDI 130 EAT8 S&S AUT. FP',
'odometer': 71981,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514487,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380846,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04071609-5057-5dc6-96a3-8c1593d9087c/04071609-5057-5dc6-96a3-8c1593d9087c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/1edb12d4611d42779708c481b190899c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 308 SW (PC) SW ALLURE BLUEHDI 130 EAT8 S&S AUT. FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988868%27 HTTP/1.1" 200 None
2026-03-27 16:32:35 [ayvens.it] INFO: Saving data for 1988868: {'created_time': 1774629155.85321, 'last_price_update_time': 1774629155.85322, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988868') HTTP/1.1" 204 0
2026-03-27 16:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/3.jpg not downloaded yet
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f06010>
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fd1aad516295c4e6780f8a52f0ceef0e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/8.jpg saved to cache
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8750ff9-b61d-5ee7-a525-6021f9ae3790
2026-03-27 16:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8750ff9-b61d-5ee7-a525-6021f9ae3790, skipping ID generation
2026-03-27 16:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8750ff9-b61d-5ee7-a525-6021f9ae3790 with scrape type 1
2026-03-27 16:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8750ff9-b61d-5ee7-a525-6021f9ae3790 sending to next pipeline
2026-03-27 16:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f8750ff9-b61d-5ee7-a525-6021f9ae3790, identifier: 1988869
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c57b50>
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/3.jpg saved to cache
2026-03-27 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4b750>
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/5.jpg saved to cache
2026-03-27 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928f010>
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/7.jpg saved to cache
2026-03-27 16:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f8750ff9-b61d-5ee7-a525-6021f9ae3790 with identifier: 1988869
2026-03-27 16:32:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f8750ff9-b61d-5ee7-a525-6021f9ae3790 with identifier: 1988869
2026-03-27 16:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f8750ff9-b61d-5ee7-a525-6021f9ae3790 with identifier: 1988869 to the API
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NAUTIK BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'f8750ff9-b61d-5ee7-a525-6021f9ae3790',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND (PC) 1.2 110CV ELEGANCE S&S MT6 FP',
'odometer': 68019,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 767481,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492473,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571956,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517851,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8750ff9-b61d-5ee7-a525-6021f9ae3790/f8750ff9-b61d-5ee7-a525-6021f9ae3790_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436362,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/d1aad516295c4e6780f8a52f0ceef0e0/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND (PC) 1.2 110CV ELEGANCE S&S MT6 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988869%27 HTTP/1.1" 200 None
2026-03-27 16:32:37 [ayvens.it] INFO: Saving data for 1988869: {'created_time': 1774629157.070402, 'last_price_update_time': 1774629157.070413, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988869') HTTP/1.1" 204 0
2026-03-27 16:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/4.jpg not downloaded yet
2026-03-27 16:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/5.jpg not downloaded yet
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68610690>
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/6.jpg saved to cache
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/6.jpg not downloaded yet
2026-03-27 16:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/7.jpg not downloaded yet
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b56b90>
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/4.jpg saved to cache
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922fbd0>
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh6%252F50901db4176e48fdad44713358103ea2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/8.jpg saved to cache
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5
2026-03-27 16:32:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6d52ba4-cc90-55b0-a898-75af5a4f3ba5, skipping ID generation
2026-03-27 16:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5 with scrape type 1
2026-03-27 16:32:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6d52ba4-cc90-55b0-a898-75af5a4f3ba5 sending to next pipeline
2026-03-27 16:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d6d52ba4-cc90-55b0-a898-75af5a4f3ba5, identifier: 1988859
2026-03-27 16:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d6d52ba4-cc90-55b0-a898-75af5a4f3ba5 with identifier: 1988859
2026-03-27 16:32:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d6d52ba4-cc90-55b0-a898-75af5a4f3ba5 with identifier: 1988859
2026-03-27 16:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d6d52ba4-cc90-55b0-a898-75af5a4f3ba5 with identifier: 1988859 to the API
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio Moda metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'd6d52ba4-cc90-55b0-a898-75af5a4f3ba5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500X 1.3 T4 150cv DCT E6D Connect Cross over 5-door (Euro 6D)',
'odometer': 113049,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564016,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564016,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d52ba4-cc90-55b0-a898-75af5a4f3ba5/d6d52ba4-cc90-55b0-a898-75af5a4f3ba5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh6/50901db4176e48fdad44713358103ea2/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500X 1.3 T4 150cv DCT E6D Connect Cross over 5-door (Euro '
'6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988859%27 HTTP/1.1" 200 None
2026-03-27 16:32:37 [ayvens.it] INFO: Saving data for 1988859: {'created_time': 1774629157.968528, 'last_price_update_time': 1774629157.968539, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988859') HTTP/1.1" 204 0
2026-03-27 16:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/8.jpg not downloaded yet
2026-03-27 16:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/9.jpg not downloaded yet
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c49710>
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg7%252F7f93e46e7d4749b1a6680b838c1e1ffd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/7.jpg saved to cache
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4
2026-03-27 16:32:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14759551-997f-5ac9-ae3f-50d9e50ca3e4, skipping ID generation
2026-03-27 16:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4 with scrape type 1
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14759551-997f-5ac9-ae3f-50d9e50ca3e4 sending to next pipeline
2026-03-27 16:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 14759551-997f-5ac9-ae3f-50d9e50ca3e4, identifier: 1988860
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b8ac90>
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/10.jpg saved to cache
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69143250>
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/4.jpg saved to cache
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd51d0>
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/2.jpg saved to cache
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/10.jpg not downloaded yet
2026-03-27 16:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 14759551-997f-5ac9-ae3f-50d9e50ca3e4 with identifier: 1988860
2026-03-27 16:32:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 14759551-997f-5ac9-ae3f-50d9e50ca3e4 with identifier: 1988860
2026-03-27 16:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 14759551-997f-5ac9-ae3f-50d9e50ca3e4 with identifier: 1988860 to the API
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NIGHT SHADE BLUE METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '14759551-997f-5ac9-ae3f-50d9e50ca3e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP',
'odometer': 135389,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 889087,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 751401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 907795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774032,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14759551-997f-5ac9-ae3f-50d9e50ca3e4/14759551-997f-5ac9-ae3f-50d9e50ca3e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg7/7f93e46e7d4749b1a6680b838c1e1ffd/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988860%27 HTTP/1.1" 200 None
2026-03-27 16:32:38 [ayvens.it] INFO: Saving data for 1988860: {'created_time': 1774629158.880516, 'last_price_update_time': 1774629158.880527, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988860') HTTP/1.1" 204 0
2026-03-27 16:32:38 [ayvens.it] INFO: Found listing with ID: 1988873
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988873%27 HTTP/1.1" 200 None
2026-03-27 16:32:38 [ayvens.it] INFO: Scrape type for 1988873: 1
2026-03-27 16:32:38 [ayvens.it] INFO: Extracting data for car ID: 1988873
2026-03-27 16:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9acdc625-040e-58de-8b6a-cf7077ee2720 with identifier: 1988873
2026-03-27 16:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acdc625-040e-58de-8b6a-cf7077ee2720 with scrape type 1
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/1.jpg not downloaded yet
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd5690>
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/3.jpg saved to cache
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa27750>
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/5.jpg saved to cache
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/2.jpg not downloaded yet
2026-03-27 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/3.jpg not downloaded yet
2026-03-27 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/4.jpg not downloaded yet
2026-03-27 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/5.jpg not downloaded yet
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/6.jpg not downloaded yet
2026-03-27 16:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/7.jpg not downloaded yet
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835e3d0>
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/1.jpg saved to cache
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af7e10>
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/10.jpg saved to cache
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/8.jpg not downloaded yet
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/9.jpg not downloaded yet
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb62d0>
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/8.jpg saved to cache
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68530290>
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/9.jpg saved to cache
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69140d90>
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/6.jpg saved to cache
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c7a990>
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/7.jpg saved to cache
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853f950>
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fb659cf3263b646b5b6c86e1f03aae5ce%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/10.jpg saved to cache
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9a73218-f66c-5a83-a8ea-fa64869e0144
2026-03-27 16:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9a73218-f66c-5a83-a8ea-fa64869e0144, skipping ID generation
2026-03-27 16:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a73218-f66c-5a83-a8ea-fa64869e0144 with scrape type 1
2026-03-27 16:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9a73218-f66c-5a83-a8ea-fa64869e0144 sending to next pipeline
2026-03-27 16:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d9a73218-f66c-5a83-a8ea-fa64869e0144, identifier: 1988871
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b55a90>
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/2.jpg saved to cache
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d9a73218-f66c-5a83-a8ea-fa64869e0144 with identifier: 1988871
2026-03-27 16:32:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d9a73218-f66c-5a83-a8ea-fa64869e0144 with identifier: 1988871
2026-03-27 16:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d9a73218-f66c-5a83-a8ea-fa64869e0144 with identifier: 1988871 to the API
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio graphite metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'd9a73218-f66c-5a83-a8ea-fa64869e0144',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KAMIQ 1.0 TSI 81KW STYLE DSG Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 51773,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650782,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495344,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a73218-f66c-5a83-a8ea-fa64869e0144/d9a73218-f66c-5a83-a8ea-fa64869e0144_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628339,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/b659cf3263b646b5b6c86e1f03aae5ce/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KAMIQ 1.0 TSI 81KW STYLE DSG Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988871%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [ayvens.it] INFO: Saving data for 1988871: {'created_time': 1774629160.341134, 'last_price_update_time': 1774629160.341144, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988871') HTTP/1.1" 204 0
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/10.jpg not downloaded yet
2026-03-27 16:32:40 [ayvens.it] INFO: Found listing with ID: 1988874
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988874%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [ayvens.it] INFO: Scrape type for 1988874: 1
2026-03-27 16:32:40 [ayvens.it] INFO: Extracting data for car ID: 1988874
2026-03-27 16:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with identifier: 1988874
2026-03-27 16:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with scrape type 1
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/1.jpg not downloaded yet
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f6e90>
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/9.jpg saved to cache
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/2.jpg not downloaded yet
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/3.jpg not downloaded yet
2026-03-27 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/4.jpg not downloaded yet
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/5.jpg not downloaded yet
2026-03-27 16:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/6.jpg not downloaded yet
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/7.jpg not downloaded yet
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1ff50>
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/6.jpg saved to cache
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/8.jpg not downloaded yet
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69300e50>
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/7.jpg saved to cache
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/9.jpg not downloaded yet
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/10.jpg not downloaded yet
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf5010>
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/1.jpg saved to cache
2026-03-27 16:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936b550>
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/4.jpg saved to cache
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f074d0>
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/5.jpg saved to cache
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca3f90>
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/8.jpg saved to cache
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68baac50>
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/3.jpg saved to cache
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:41 [ayvens.it] INFO: Found listing with ID: 1988875
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988875%27 HTTP/1.1" 200 None
2026-03-27 16:32:41 [ayvens.it] INFO: Scrape type for 1988875: 1
2026-03-27 16:32:41 [ayvens.it] INFO: Extracting data for car ID: 1988875
2026-03-27 16:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fac2ddc5-df99-556a-929e-2e2894efcd2b with identifier: 1988875
2026-03-27 16:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac2ddc5-df99-556a-929e-2e2894efcd2b with scrape type 1
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/1.jpg not downloaded yet
2026-03-27 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/2.jpg not downloaded yet
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/3.jpg not downloaded yet
2026-03-27 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/4.jpg not downloaded yet
2026-03-27 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/5.jpg not downloaded yet
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b4b010>
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/1.jpg saved to cache
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/6.jpg not downloaded yet
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/7.jpg not downloaded yet
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/8.jpg not downloaded yet
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2a50>
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/10.jpg saved to cache
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c78110>
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy2%252Fc0dd4c5e664040dabe8712e48c14c305%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/9.jpg saved to cache
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3409c17-3df5-500a-a99e-bb10218ccb97
2026-03-27 16:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3409c17-3df5-500a-a99e-bb10218ccb97, skipping ID generation
2026-03-27 16:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3409c17-3df5-500a-a99e-bb10218ccb97 with scrape type 1
2026-03-27 16:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3409c17-3df5-500a-a99e-bb10218ccb97 sending to next pipeline
2026-03-27 16:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c3409c17-3df5-500a-a99e-bb10218ccb97, identifier: 1988872
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69160c10>
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/8.jpg saved to cache
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1e110>
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F0a32fc1616a7416b85c59330e42a3884%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/8.jpg saved to cache
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c80d7785-9f42-51ea-960e-5d3de1ff2a17
2026-03-27 16:32:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c80d7785-9f42-51ea-960e-5d3de1ff2a17, skipping ID generation
2026-03-27 16:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80d7785-9f42-51ea-960e-5d3de1ff2a17 with scrape type 1
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c80d7785-9f42-51ea-960e-5d3de1ff2a17 sending to next pipeline
2026-03-27 16:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c80d7785-9f42-51ea-960e-5d3de1ff2a17, identifier: 1988870
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69327590>
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/3.jpg saved to cache
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922efd0>
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/4.jpg saved to cache
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e698e9bd0>
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/2.jpg saved to cache
2026-03-27 16:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c3409c17-3df5-500a-a99e-bb10218ccb97 with identifier: 1988872
2026-03-27 16:32:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c3409c17-3df5-500a-a99e-bb10218ccb97 with identifier: 1988872
2026-03-27 16:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c3409c17-3df5-500a-a99e-bb10218ccb97 with identifier: 1988872 to the API
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GENERIC COLOR',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'c3409c17-3df5-500a-a99e-bb10218ccb97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 SDRIVE 20I DCT',
'odometer': 25,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781058,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596546,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3409c17-3df5-500a-a99e-bb10218ccb97/c3409c17-3df5-500a-a99e-bb10218ccb97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy2/c0dd4c5e664040dabe8712e48c14c305/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 SDRIVE 20I DCT -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2025}
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988872%27 HTTP/1.1" 200 None
2026-03-27 16:32:42 [ayvens.it] INFO: Saving data for 1988872: {'created_time': 1774629162.82922, 'last_price_update_time': 1774629162.829231, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988872') HTTP/1.1" 204 0
2026-03-27 16:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c80d7785-9f42-51ea-960e-5d3de1ff2a17 with identifier: 1988870
2026-03-27 16:32:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c80d7785-9f42-51ea-960e-5d3de1ff2a17 with identifier: 1988870
2026-03-27 16:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c80d7785-9f42-51ea-960e-5d3de1ff2a17 with identifier: 1988870 to the API
2026-03-27 16:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'c80d7785-9f42-51ea-960e-5d3de1ff2a17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO (PC) FURGONE 33 L2H2 BLUEHDI 140 S&S FP',
'odometer': 122630,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481028,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481028,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80d7785-9f42-51ea-960e-5d3de1ff2a17/c80d7785-9f42-51ea-960e-5d3de1ff2a17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/0a32fc1616a7416b85c59330e42a3884/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO (PC) FURGONE 33 L2H2 BLUEHDI 140 S&S FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988870%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [ayvens.it] INFO: Saving data for 1988870: {'created_time': 1774629163.539861, 'last_price_update_time': 1774629163.539873, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988870') HTTP/1.1" 204 0
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/9.jpg not downloaded yet
2026-03-27 16:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/10.jpg not downloaded yet
2026-03-27 16:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:43 [ayvens.it] INFO: Found listing with ID: 1988876
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988876%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [ayvens.it] INFO: Scrape type for 1988876: 1
2026-03-27 16:32:43 [ayvens.it] INFO: Extracting data for car ID: 1988876
2026-03-27 16:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95274bde-7267-5245-a4c3-bf013298eef0 with identifier: 1988876
2026-03-27 16:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95274bde-7267-5245-a4c3-bf013298eef0 with scrape type 1
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/1.jpg not downloaded yet
2026-03-27 16:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/2.jpg not downloaded yet
2026-03-27 16:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/3.jpg not downloaded yet
2026-03-27 16:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/4.jpg not downloaded yet
2026-03-27 16:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/5.jpg not downloaded yet
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/6.jpg not downloaded yet
2026-03-27 16:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb6f50>
2026-03-27 16:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/10.jpg saved to cache
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d00090>
2026-03-27 16:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/9.jpg saved to cache
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/7.jpg not downloaded yet
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/8.jpg not downloaded yet
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b32450>
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/7.jpg saved to cache
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b64a10>
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/1.jpg saved to cache
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b316650>
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/6.jpg saved to cache
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b3d290>
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/2.jpg saved to cache
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68514110>
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/8.jpg saved to cache
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f2390>
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/3.jpg saved to cache
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/9.jpg not downloaded yet
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/10.jpg not downloaded yet
2026-03-27 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:44 [ayvens.it] INFO: Found listing with ID: 1988877
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988877%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [ayvens.it] INFO: Scrape type for 1988877: 1
2026-03-27 16:32:44 [ayvens.it] INFO: Extracting data for car ID: 1988877
2026-03-27 16:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31fda52f-41b5-528c-adac-ee5ddf246cc3 with identifier: 1988877
2026-03-27 16:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31fda52f-41b5-528c-adac-ee5ddf246cc3 with scrape type 1
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/1.jpg not downloaded yet
2026-03-27 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/2.jpg not downloaded yet
2026-03-27 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/3.jpg not downloaded yet
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/4.jpg not downloaded yet
2026-03-27 16:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/5.jpg not downloaded yet
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b3e0d0>
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/10.jpg saved to cache
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b73d0>
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/9.jpg saved to cache
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/6.jpg not downloaded yet
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/7.jpg not downloaded yet
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69237b50>
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/6.jpg saved to cache
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f047d0>
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/7.jpg saved to cache
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec3350>
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/4.jpg saved to cache
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c22d50>
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/6.jpg saved to cache
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fac6d0>
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/5.jpg saved to cache
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fae050>
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/1.jpg saved to cache
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/8.jpg not downloaded yet
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/9.jpg not downloaded yet
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/10.jpg not downloaded yet
2026-03-27 16:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:45 [ayvens.it] INFO: Found listing with ID: 1988878
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988878%27 HTTP/1.1" 200 None
2026-03-27 16:32:45 [ayvens.it] INFO: Scrape type for 1988878: 1
2026-03-27 16:32:45 [ayvens.it] INFO: Extracting data for car ID: 1988878
2026-03-27 16:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with identifier: 1988878
2026-03-27 16:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with scrape type 1
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/1.jpg not downloaded yet
2026-03-27 16:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/2.jpg not downloaded yet
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/3.jpg not downloaded yet
2026-03-27 16:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/4.jpg not downloaded yet
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/5.jpg not downloaded yet
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2c90>
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/1.jpg saved to cache
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a69c10>
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/8.jpg saved to cache
2026-03-27 16:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69142010>
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/7.jpg saved to cache
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/6.jpg not downloaded yet
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/7.jpg not downloaded yet
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/8.jpg not downloaded yet
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef7e90>
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/10.jpg saved to cache
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69072850>
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/3.jpg saved to cache
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b70110>
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/6.jpg saved to cache
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914f290>
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/9.jpg saved to cache
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b71f50>
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/5.jpg saved to cache
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/9.jpg not downloaded yet
2026-03-27 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/10.jpg not downloaded yet
2026-03-27 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:46 [ayvens.it] INFO: Found listing with ID: 1988879
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988879%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [ayvens.it] INFO: Scrape type for 1988879: 1
2026-03-27 16:32:46 [ayvens.it] INFO: Extracting data for car ID: 1988879
2026-03-27 16:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d46067-3fd5-5265-81d8-941b4602a013 with identifier: 1988879
2026-03-27 16:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d46067-3fd5-5265-81d8-941b4602a013 with scrape type 1
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/1.jpg not downloaded yet
2026-03-27 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/2.jpg not downloaded yet
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/3.jpg not downloaded yet
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/4.jpg not downloaded yet
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69008e90>
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/8.jpg saved to cache
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/5.jpg not downloaded yet
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd5110>
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/10.jpg saved to cache
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/6.jpg not downloaded yet
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/7.jpg not downloaded yet
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d83d0>
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/9.jpg saved to cache
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd1ed0>
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/5.jpg saved to cache
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aeaf90>
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/1.jpg saved to cache
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9a050>
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/4.jpg saved to cache
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69093f10>
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/2.jpg saved to cache
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bce290>
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/3.jpg saved to cache
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/8.jpg not downloaded yet
2026-03-27 16:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/9.jpg not downloaded yet
2026-03-27 16:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/10.jpg not downloaded yet
2026-03-27 16:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:47 [ayvens.it] INFO: Found listing with ID: 1988880
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988880%27 HTTP/1.1" 200 None
2026-03-27 16:32:47 [ayvens.it] INFO: Scrape type for 1988880: 1
2026-03-27 16:32:47 [ayvens.it] INFO: Extracting data for car ID: 1988880
2026-03-27 16:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8266c022-3d29-5bf4-b747-4794e2a2c615 with identifier: 1988880
2026-03-27 16:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8266c022-3d29-5bf4-b747-4794e2a2c615 with scrape type 1
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/1.jpg not downloaded yet
2026-03-27 16:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/2.jpg not downloaded yet
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/3.jpg not downloaded yet
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/4.jpg not downloaded yet
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb7e50>
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/6.jpg saved to cache
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/5.jpg not downloaded yet
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acd510>
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/9.jpg saved to cache
2026-03-27 16:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff5050>
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/10.jpg saved to cache
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68baa0d0>
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/6.jpg saved to cache
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f995d0>
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/7.jpg saved to cache
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6901bf50>
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/8.jpg saved to cache
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/6.jpg not downloaded yet
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/7.jpg not downloaded yet
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914dc10>
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/5.jpg saved to cache
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2e390>
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F4d3aefd4f22b46ab9890d076f523347d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/7.jpg saved to cache
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31fda52f-41b5-528c-adac-ee5ddf246cc3
2026-03-27 16:32:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31fda52f-41b5-528c-adac-ee5ddf246cc3, skipping ID generation
2026-03-27 16:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31fda52f-41b5-528c-adac-ee5ddf246cc3 with scrape type 1
2026-03-27 16:32:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31fda52f-41b5-528c-adac-ee5ddf246cc3 sending to next pipeline
2026-03-27 16:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 31fda52f-41b5-528c-adac-ee5ddf246cc3, identifier: 1988877
2026-03-27 16:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 31fda52f-41b5-528c-adac-ee5ddf246cc3 with identifier: 1988877
2026-03-27 16:32:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 31fda52f-41b5-528c-adac-ee5ddf246cc3 with identifier: 1988877
2026-03-27 16:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 31fda52f-41b5-528c-adac-ee5ddf246cc3 with identifier: 1988877 to the API
2026-03-27 16:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Clear White',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '31fda52f-41b5-528c-adac-ee5ddf246cc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'KIA PICANTO 1.0 STYLE Hatchback 5-door (Euro 6D)',
'odometer': 151609,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 741894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 741894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509405,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660151,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31fda52f-41b5-528c-adac-ee5ddf246cc3/31fda52f-41b5-528c-adac-ee5ddf246cc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/4d3aefd4f22b46ab9890d076f523347d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'KIA KIA PICANTO 1.0 STYLE Hatchback 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988877%27 HTTP/1.1" 200 None
2026-03-27 16:32:49 [ayvens.it] INFO: Saving data for 1988877: {'created_time': 1774629169.181231, 'last_price_update_time': 1774629169.181242, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988877') HTTP/1.1" 204 0
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/8.jpg not downloaded yet
2026-03-27 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/9.jpg not downloaded yet
2026-03-27 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/10.jpg not downloaded yet
2026-03-27 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:49 [ayvens.it] INFO: Found listing with ID: 1988881
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988881%27 HTTP/1.1" 200 None
2026-03-27 16:32:49 [ayvens.it] INFO: Scrape type for 1988881: 1
2026-03-27 16:32:49 [ayvens.it] INFO: Extracting data for car ID: 1988881
2026-03-27 16:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 483367a7-9424-5972-b06a-1bbfe0906820 with identifier: 1988881
2026-03-27 16:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483367a7-9424-5972-b06a-1bbfe0906820 with scrape type 1
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/1.jpg not downloaded yet
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/2.jpg not downloaded yet
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/3.jpg not downloaded yet
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68545410>
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/8.jpg saved to cache
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b3cb50>
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/7.jpg saved to cache
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/4.jpg not downloaded yet
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c229d0>
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/9.jpg saved to cache
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69140050>
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/10.jpg saved to cache
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c344d0>
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/4.jpg saved to cache
2026-03-27 16:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916f190>
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/2.jpg saved to cache
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/5.jpg not downloaded yet
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/6.jpg not downloaded yet
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf4e10>
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/5.jpg saved to cache
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922d310>
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/3.jpg saved to cache
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/7.jpg not downloaded yet
2026-03-27 16:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/8.jpg not downloaded yet
2026-03-27 16:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/9.jpg not downloaded yet
2026-03-27 16:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/10.jpg not downloaded yet
2026-03-27 16:32:50 [ayvens.it] INFO: Found listing with ID: 1988882
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988882%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [ayvens.it] INFO: Scrape type for 1988882: 1
2026-03-27 16:32:50 [ayvens.it] INFO: Extracting data for car ID: 1988882
2026-03-27 16:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with identifier: 1988882
2026-03-27 16:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with scrape type 1
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/1.jpg not downloaded yet
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/2.jpg not downloaded yet
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c56e90>
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/8.jpg saved to cache
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ae9a90>
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/7.jpg saved to cache
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc8dd0>
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/9.jpg saved to cache
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b57f10>
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/6.jpg saved to cache
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69355e50>
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/1.jpg saved to cache
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835d110>
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/4.jpg saved to cache
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/3.jpg not downloaded yet
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfce50>
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/4.jpg saved to cache
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c78490>
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/5.jpg saved to cache
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/4.jpg not downloaded yet
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/5.jpg not downloaded yet
2026-03-27 16:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/6.jpg not downloaded yet
2026-03-27 16:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/7.jpg not downloaded yet
2026-03-27 16:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/8.jpg not downloaded yet
2026-03-27 16:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/9.jpg not downloaded yet
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/10.jpg not downloaded yet
2026-03-27 16:32:51 [ayvens.it] INFO: Found listing with ID: 1988883
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988883%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [ayvens.it] INFO: Scrape type for 1988883: 1
2026-03-27 16:32:51 [ayvens.it] INFO: Extracting data for car ID: 1988883
2026-03-27 16:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac220478-7c47-5d52-b723-fd3c48b4f816 with identifier: 1988883
2026-03-27 16:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac220478-7c47-5d52-b723-fd3c48b4f816 with scrape type 1
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/1.jpg not downloaded yet
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d475d0>
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/8.jpg saved to cache
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/2.jpg not downloaded yet
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69356c50>
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/7.jpg saved to cache
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c57310>
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/6.jpg saved to cache
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f07a50>
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/4.jpg saved to cache
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853ffd0>
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/1.jpg saved to cache
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af4310>
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/2.jpg saved to cache
2026-03-27 16:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b6dd0>
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/3.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d45490>
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/3.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/3.jpg not downloaded yet
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/4.jpg not downloaded yet
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/5.jpg not downloaded yet
2026-03-27 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/6.jpg not downloaded yet
2026-03-27 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/7.jpg not downloaded yet
2026-03-27 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/8.jpg not downloaded yet
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/9.jpg not downloaded yet
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/10.jpg not downloaded yet
2026-03-27 16:32:52 [ayvens.it] INFO: Found listing with ID: 1988884
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988884%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [ayvens.it] INFO: Scrape type for 1988884: 1
2026-03-27 16:32:52 [ayvens.it] INFO: Extracting data for car ID: 1988884
2026-03-27 16:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17138f5a-8876-53e5-9d35-3e01c34eb488 with identifier: 1988884
2026-03-27 16:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17138f5a-8876-53e5-9d35-3e01c34eb488 with scrape type 1
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/1.jpg not downloaded yet
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/2.jpg not downloaded yet
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6aa90>
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/10.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9a750>
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/6.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ca810>
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/8.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bee150>
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/9.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691cbbd0>
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/7.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d342d0>
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/5.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c9ed0>
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/2.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad10990>
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/3.jpg saved to cache
2026-03-27 16:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/3.jpg not downloaded yet
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/4.jpg not downloaded yet
2026-03-27 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/5.jpg not downloaded yet
2026-03-27 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/6.jpg not downloaded yet
2026-03-27 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/7.jpg not downloaded yet
2026-03-27 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/8.jpg not downloaded yet
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/9.jpg not downloaded yet
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/10.jpg not downloaded yet
2026-03-27 16:32:53 [ayvens.it] INFO: Found listing with ID: 1988885
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988885%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [ayvens.it] INFO: Scrape type for 1988885: 1
2026-03-27 16:32:53 [ayvens.it] INFO: Extracting data for car ID: 1988885
2026-03-27 16:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81 with identifier: 1988885
2026-03-27 16:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81 with scrape type 1
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/1.jpg not downloaded yet
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6850af90>
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/7.jpg saved to cache
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/2.jpg not downloaded yet
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8d450>
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/6.jpg saved to cache
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69140490>
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/3.jpg saved to cache
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900aad0>
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/10.jpg saved to cache
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdd650>
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/5.jpg saved to cache
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/3.jpg not downloaded yet
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/4.jpg not downloaded yet
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68faf650>
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/4.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b73010>
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/2.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd2050>
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/1.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/5.jpg not downloaded yet
2026-03-27 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/6.jpg not downloaded yet
2026-03-27 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/7.jpg not downloaded yet
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/8.jpg not downloaded yet
2026-03-27 16:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/9.jpg not downloaded yet
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/10.jpg not downloaded yet
2026-03-27 16:32:54 [ayvens.it] INFO: Found listing with ID: 1988886
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988886%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [ayvens.it] INFO: Scrape type for 1988886: 1
2026-03-27 16:32:54 [ayvens.it] INFO: Extracting data for car ID: 1988886
2026-03-27 16:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09 with identifier: 1988886
2026-03-27 16:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09 with scrape type 1
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/1.jpg not downloaded yet
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/2.jpg not downloaded yet
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b70190>
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/4.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c9af10>
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/5.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6ad50>
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/10.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c98450>
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/3.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c69510>
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/9.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb4450>
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/8.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69163c90>
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/6.jpg saved to cache
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/3.jpg not downloaded yet
2026-03-27 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cde910>
2026-03-27 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F74e5ddadf24c4eb0a4f409a11b67047d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/1.jpg saved to cache
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a
2026-03-27 16:32:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a, skipping ID generation
2026-03-27 16:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with scrape type 1
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e0240b9-2b81-5e3a-83e1-95c8245fc12a sending to next pipeline
2026-03-27 16:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a, identifier: 1988882
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/4.jpg not downloaded yet
2026-03-27 16:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with identifier: 1988882
2026-03-27 16:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with identifier: 1988882
2026-03-27 16:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2e0240b9-2b81-5e3a-83e1-95c8245fc12a with identifier: 1988882 to the API
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '2e0240b9-2b81-5e3a-83e1-95c8245fc12a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 308 SW (PC) SW ALLURE PACK BLUEHDI 130 EAT8 S&S FP',
'odometer': 104285,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750918,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0240b9-2b81-5e3a-83e1-95c8245fc12a/2e0240b9-2b81-5e3a-83e1-95c8245fc12a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515815,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/74e5ddadf24c4eb0a4f409a11b67047d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 308 SW (PC) SW ALLURE PACK BLUEHDI 130 EAT8 S&S FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988882%27 HTTP/1.1" 200 None
2026-03-27 16:32:55 [ayvens.it] INFO: Saving data for 1988882: {'created_time': 1774629175.774912, 'last_price_update_time': 1774629175.774928, 'auction_closing_time': 1774944000.0}
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988882') HTTP/1.1" 204 0
2026-03-27 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/5.jpg not downloaded yet
2026-03-27 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/6.jpg not downloaded yet
2026-03-27 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/7.jpg not downloaded yet
2026-03-27 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/8.jpg not downloaded yet
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/9.jpg not downloaded yet
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/10.jpg not downloaded yet
2026-03-27 16:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6901a690>
2026-03-27 16:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/4.jpg saved to cache
2026-03-27 16:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:32:55 [ayvens.it] INFO: Found listing with ID: 1988887
2026-03-27 16:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988887%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [ayvens.it] INFO: Scrape type for 1988887: 1
2026-03-27 16:32:56 [ayvens.it] INFO: Extracting data for car ID: 1988887
2026-03-27 16:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c610390-ec4a-5f7b-9302-f31033033fa0 with identifier: 1988887
2026-03-27 16:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c610390-ec4a-5f7b-9302-f31033033fa0 with scrape type 1
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/1.jpg not downloaded yet
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af7e50>
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/10.jpg saved to cache
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/2.jpg not downloaded yet
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/3.jpg not downloaded yet
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690d3750>
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/5.jpg saved to cache
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af5f50>
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/1.jpg saved to cache
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916d9d0>
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/2.jpg saved to cache
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68515610>
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/6.jpg saved to cache
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6901ad90>
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/9.jpg saved to cache
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af5110>
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/2.jpg saved to cache
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/4.jpg not downloaded yet
2026-03-27 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/5.jpg not downloaded yet
2026-03-27 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/6.jpg not downloaded yet
2026-03-27 16:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/7.jpg not downloaded yet
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/8.jpg not downloaded yet
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/9.jpg not downloaded yet
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/10.jpg not downloaded yet
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69324250>
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/4.jpg saved to cache
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:32:56 [ayvens.it] INFO: Found listing with ID: 1988888
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988888%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [ayvens.it] INFO: Scrape type for 1988888: 1
2026-03-27 16:32:56 [ayvens.it] INFO: Extracting data for car ID: 1988888
2026-03-27 16:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 481b2935-1c7f-52e2-8e29-d3c3ff19a589 with identifier: 1988888
2026-03-27 16:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589 with scrape type 1
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/1.jpg not downloaded yet
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0fc50>
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/9.jpg saved to cache
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b5390>
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/1.jpg saved to cache
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69338290>
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/6.jpg saved to cache
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aebd90>
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/10.jpg saved to cache
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693572d0>
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/3.jpg saved to cache
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/2.jpg not downloaded yet
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/3.jpg not downloaded yet
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acc110>
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/5.jpg saved to cache
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd7250>
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/3.jpg saved to cache
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/4.jpg not downloaded yet
2026-03-27 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/5.jpg not downloaded yet
2026-03-27 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/6.jpg not downloaded yet
2026-03-27 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/7.jpg not downloaded yet
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/8.jpg not downloaded yet
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/9.jpg not downloaded yet
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/10.jpg not downloaded yet
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69047450>
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/10.jpg saved to cache
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:32:57 [ayvens.it] INFO: Found listing with ID: 1988889
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988889%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [ayvens.it] INFO: Scrape type for 1988889: 1
2026-03-27 16:32:57 [ayvens.it] INFO: Extracting data for car ID: 1988889
2026-03-27 16:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8be09e15-08b7-5c81-9412-4f2b11cd7d26 with identifier: 1988889
2026-03-27 16:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26 with scrape type 1
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/1.jpg not downloaded yet
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/2.jpg not downloaded yet
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853d090>
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/9.jpg saved to cache
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690d1b10>
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/4.jpg saved to cache
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f1c90>
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/7.jpg saved to cache
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb4990>
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/6.jpg saved to cache
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cce010>
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/5.jpg saved to cache
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccced0>
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/1.jpg saved to cache
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f93d0>
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/2.jpg saved to cache
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/3.jpg not downloaded yet
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/4.jpg not downloaded yet
2026-03-27 16:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/5.jpg not downloaded yet
2026-03-27 16:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/6.jpg not downloaded yet
2026-03-27 16:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/7.jpg not downloaded yet
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/8.jpg not downloaded yet
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/9.jpg not downloaded yet
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/10.jpg not downloaded yet
2026-03-27 16:32:58 [ayvens.it] INFO: Found listing with ID: 1988890
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988890%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [ayvens.it] INFO: Scrape type for 1988890: 1
2026-03-27 16:32:58 [ayvens.it] INFO: Extracting data for car ID: 1988890
2026-03-27 16:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1137bb98-ef8e-5512-8a6e-358f1e32980b with identifier: 1988890
2026-03-27 16:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1137bb98-ef8e-5512-8a6e-358f1e32980b with scrape type 1
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/1.jpg not downloaded yet
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fee110>
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/6.jpg saved to cache
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/2.jpg not downloaded yet
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692370d0>
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/3.jpg saved to cache
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68520310>
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/1.jpg saved to cache
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6850a350>
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/5.jpg saved to cache
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb6050>
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/4.jpg saved to cache
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b57110>
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/2.jpg saved to cache
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69516610>
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/9.jpg saved to cache
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fed510>
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/10.jpg saved to cache
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/3.jpg not downloaded yet
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/4.jpg not downloaded yet
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/5.jpg not downloaded yet
2026-03-27 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/6.jpg not downloaded yet
2026-03-27 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/7.jpg not downloaded yet
2026-03-27 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/8.jpg not downloaded yet
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/9.jpg not downloaded yet
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/10.jpg not downloaded yet
2026-03-27 16:32:59 [ayvens.it] INFO: Found listing with ID: 1988891
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988891%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [ayvens.it] INFO: Scrape type for 1988891: 1
2026-03-27 16:32:59 [ayvens.it] INFO: Extracting data for car ID: 1988891
2026-03-27 16:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0c058ac-4530-5440-b7c1-3f58201f4436 with identifier: 1988891
2026-03-27 16:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c058ac-4530-5440-b7c1-3f58201f4436 with scrape type 1
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/1.jpg not downloaded yet
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/2.jpg not downloaded yet
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d23250>
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/1.jpg saved to cache
2026-03-27 16:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fce450>
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/10.jpg saved to cache
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912dfd0>
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/9.jpg saved to cache
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcde90>
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/5.jpg saved to cache
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff68d0>
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/3.jpg saved to cache
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcd8d0>
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/2.jpg saved to cache
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912fb10>
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/4.jpg saved to cache
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff66d0>
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/1.jpg saved to cache
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/3.jpg not downloaded yet
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/4.jpg not downloaded yet
2026-03-27 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/5.jpg not downloaded yet
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/6.jpg not downloaded yet
2026-03-27 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/7.jpg not downloaded yet
2026-03-27 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/8.jpg not downloaded yet
2026-03-27 16:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/9.jpg not downloaded yet
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/10.jpg not downloaded yet
2026-03-27 16:33:00 [ayvens.it] INFO: Found listing with ID: 1988892
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988892%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [ayvens.it] INFO: Scrape type for 1988892: 1
2026-03-27 16:33:00 [ayvens.it] INFO: Extracting data for car ID: 1988892
2026-03-27 16:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd4e699-7403-5c66-badb-abe3997e3e7b with identifier: 1988892
2026-03-27 16:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd4e699-7403-5c66-badb-abe3997e3e7b with scrape type 1
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/1.jpg not downloaded yet
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0e550>
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/4.jpg saved to cache
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/2.jpg not downloaded yet
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0e7d0>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/9.jpg saved to cache
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa182d0>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/8.jpg saved to cache
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925d0d0>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/3.jpg saved to cache
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912c310>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/10.jpg saved to cache
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b20bd0>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/1.jpg saved to cache
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/3.jpg not downloaded yet
2026-03-27 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/4.jpg not downloaded yet
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c55450>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/2.jpg saved to cache
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/5.jpg not downloaded yet
2026-03-27 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/6.jpg not downloaded yet
2026-03-27 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/7.jpg not downloaded yet
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0dc10>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/7.jpg saved to cache
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/8.jpg not downloaded yet
2026-03-27 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/9.jpg not downloaded yet
2026-03-27 16:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2d650>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/10.jpg saved to cache
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c84f10>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/5.jpg saved to cache
2026-03-27 16:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d35090>
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/4.jpg saved to cache
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ece190>
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/3.jpg saved to cache
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/10.jpg not downloaded yet
2026-03-27 16:33:02 [ayvens.it] INFO: Found listing with ID: 1988893
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988893%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [ayvens.it] INFO: Scrape type for 1988893: 1
2026-03-27 16:33:02 [ayvens.it] INFO: Extracting data for car ID: 1988893
2026-03-27 16:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff723d9f-3a4d-5560-a66a-becf39a9339d with identifier: 1988893
2026-03-27 16:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff723d9f-3a4d-5560-a66a-becf39a9339d with scrape type 1
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/1.jpg not downloaded yet
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/2.jpg not downloaded yet
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d01ed0>
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/2.jpg saved to cache
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928e250>
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/3.jpg saved to cache
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d10cd0>
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/1.jpg saved to cache
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/3.jpg not downloaded yet
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/4.jpg not downloaded yet
2026-03-27 16:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/5.jpg not downloaded yet
2026-03-27 16:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/6.jpg not downloaded yet
2026-03-27 16:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/7.jpg not downloaded yet
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/8.jpg not downloaded yet
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/9.jpg not downloaded yet
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/10.jpg not downloaded yet
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff5bd0>
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/9.jpg saved to cache
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1f6d0>
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/7.jpg saved to cache
2026-03-27 16:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1d810>
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/7.jpg saved to cache
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b31510>
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/4.jpg saved to cache
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1c4d0>
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/8.jpg saved to cache
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:03 [ayvens.it] INFO: Found listing with ID: 1988894
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988894%27 HTTP/1.1" 200 None
2026-03-27 16:33:03 [ayvens.it] INFO: Scrape type for 1988894: 1
2026-03-27 16:33:03 [ayvens.it] INFO: Extracting data for car ID: 1988894
2026-03-27 16:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a78db80-ade9-5886-a9cb-50d548eecc28 with identifier: 1988894
2026-03-27 16:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a78db80-ade9-5886-a9cb-50d548eecc28 with scrape type 1
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/1.jpg not downloaded yet
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/2.jpg not downloaded yet
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdc810>
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/5.jpg saved to cache
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c7bed0>
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/6.jpg saved to cache
2026-03-27 16:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b844690>
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fbeb482bc8b5a4ff3a966ce9037946c4d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/6.jpg saved to cache
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1137bb98-ef8e-5512-8a6e-358f1e32980b
2026-03-27 16:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1137bb98-ef8e-5512-8a6e-358f1e32980b, skipping ID generation
2026-03-27 16:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1137bb98-ef8e-5512-8a6e-358f1e32980b with scrape type 1
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1137bb98-ef8e-5512-8a6e-358f1e32980b sending to next pipeline
2026-03-27 16:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1137bb98-ef8e-5512-8a6e-358f1e32980b, identifier: 1988890
2026-03-27 16:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1137bb98-ef8e-5512-8a6e-358f1e32980b with identifier: 1988890
2026-03-27 16:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1137bb98-ef8e-5512-8a6e-358f1e32980b with identifier: 1988890
2026-03-27 16:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1137bb98-ef8e-5512-8a6e-358f1e32980b with identifier: 1988890 to the API
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ARTICO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '1137bb98-ef8e-5512-8a6e-358f1e32980b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES SPRINTER 314 CDI F39/33 T.ALTO P.M. TR.ANT. FP',
'odometer': 148312,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 88,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541212,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1137bb98-ef8e-5512-8a6e-358f1e32980b/1137bb98-ef8e-5512-8a6e-358f1e32980b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/beb482bc8b5a4ff3a966ce9037946c4d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES SPRINTER 314 CDI F39/33 T.ALTO P.M. TR.ANT. '
'FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988890%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [ayvens.it] INFO: Saving data for 1988890: {'created_time': 1774629184.508744, 'last_price_update_time': 1774629184.508757, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988890') HTTP/1.1" 204 0
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/3.jpg not downloaded yet
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/4.jpg not downloaded yet
2026-03-27 16:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/5.jpg not downloaded yet
2026-03-27 16:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/6.jpg not downloaded yet
2026-03-27 16:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/7.jpg not downloaded yet
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/8.jpg not downloaded yet
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/9.jpg not downloaded yet
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/10.jpg not downloaded yet
2026-03-27 16:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b85e090>
2026-03-27 16:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/7.jpg saved to cache
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:04 [ayvens.it] INFO: Found listing with ID: 1988895
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988895%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [ayvens.it] INFO: Scrape type for 1988895: 1
2026-03-27 16:33:04 [ayvens.it] INFO: Extracting data for car ID: 1988895
2026-03-27 16:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c82136c-c007-5181-a579-2308c1a34463 with identifier: 1988895
2026-03-27 16:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c82136c-c007-5181-a579-2308c1a34463 with scrape type 1
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/1.jpg not downloaded yet
2026-03-27 16:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c20290>
2026-03-27 16:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/6.jpg saved to cache
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/2.jpg not downloaded yet
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/3.jpg not downloaded yet
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c35410>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/10.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c20910>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/3.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aea6d0>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/4.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fafd50>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/2.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916eed0>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/1.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b72310>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/5.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/4.jpg not downloaded yet
2026-03-27 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/5.jpg not downloaded yet
2026-03-27 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/6.jpg not downloaded yet
2026-03-27 16:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/7.jpg not downloaded yet
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/8.jpg not downloaded yet
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/9.jpg not downloaded yet
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/10.jpg not downloaded yet
2026-03-27 16:33:05 [ayvens.it] INFO: Found listing with ID: 1988896
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988896%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [ayvens.it] INFO: Scrape type for 1988896: 1
2026-03-27 16:33:05 [ayvens.it] INFO: Extracting data for car ID: 1988896
2026-03-27 16:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 724aa208-77a3-56ba-acee-1283ad99da0c with identifier: 1988896
2026-03-27 16:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 724aa208-77a3-56ba-acee-1283ad99da0c with scrape type 1
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/1.jpg not downloaded yet
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d35050>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/3.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5df10>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/2.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/2.jpg not downloaded yet
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e695173d0>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/1.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad11590>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/9.jpg saved to cache
2026-03-27 16:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693035d0>
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/4.jpg saved to cache
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b03d50>
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/10.jpg saved to cache
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6a9ff950>
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/1.jpg saved to cache
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d344d0>
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/9.jpg saved to cache
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -1 pages/min), scraped 47 items (at 20 items/min)
2026-03-27 16:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/3.jpg not downloaded yet
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/4.jpg not downloaded yet
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/5.jpg not downloaded yet
2026-03-27 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/6.jpg not downloaded yet
2026-03-27 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/7.jpg not downloaded yet
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/8.jpg not downloaded yet
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/9.jpg not downloaded yet
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/10.jpg not downloaded yet
2026-03-27 16:33:06 [ayvens.it] INFO: Found listing with ID: 1988897
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988897%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [ayvens.it] INFO: Scrape type for 1988897: 1
2026-03-27 16:33:06 [ayvens.it] INFO: Extracting data for car ID: 1988897
2026-03-27 16:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92cc3f1d-4897-546a-b857-37a8887fcab5 with identifier: 1988897
2026-03-27 16:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92cc3f1d-4897-546a-b857-37a8887fcab5 with scrape type 1
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/1.jpg not downloaded yet
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b03890>
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/3.jpg saved to cache
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923ecd0>
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/7.jpg saved to cache
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/2.jpg not downloaded yet
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b69d0>
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/8.jpg saved to cache
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b4ad50>
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/2.jpg saved to cache
2026-03-27 16:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c78d50>
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/1.jpg saved to cache
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69327f90>
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/2.jpg saved to cache
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6933ad90>
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/4.jpg saved to cache
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b6bd0>
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/5.jpg saved to cache
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/3.jpg not downloaded yet
2026-03-27 16:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/4.jpg not downloaded yet
2026-03-27 16:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/5.jpg not downloaded yet
2026-03-27 16:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/6.jpg not downloaded yet
2026-03-27 16:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/7.jpg not downloaded yet
2026-03-27 16:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/8.jpg not downloaded yet
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/9.jpg not downloaded yet
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925f990>
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/4.jpg saved to cache
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/10.jpg not downloaded yet
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18110>
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/10.jpg saved to cache
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:07 [ayvens.it] INFO: Found listing with ID: 1988898
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988898%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [ayvens.it] INFO: Scrape type for 1988898: 1
2026-03-27 16:33:07 [ayvens.it] INFO: Extracting data for car ID: 1988898
2026-03-27 16:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef281b05-4a91-505d-a4ed-6514e3dd1968 with identifier: 1988898
2026-03-27 16:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef281b05-4a91-505d-a4ed-6514e3dd1968 with scrape type 1
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/1.jpg not downloaded yet
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/2.jpg not downloaded yet
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b1ab710>
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/9.jpg saved to cache
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925f3d0>
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/3.jpg saved to cache
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6933bdd0>
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/7.jpg saved to cache
2026-03-27 16:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd3c90>
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/8.jpg saved to cache
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fca6d0>
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/1.jpg saved to cache
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6add5950>
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/2.jpg saved to cache
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/3.jpg not downloaded yet
2026-03-27 16:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/4.jpg not downloaded yet
2026-03-27 16:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/5.jpg not downloaded yet
2026-03-27 16:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/6.jpg not downloaded yet
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/7.jpg not downloaded yet
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/8.jpg not downloaded yet
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/9.jpg not downloaded yet
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/10.jpg not downloaded yet
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a699d0>
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/10.jpg saved to cache
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fed9d0>
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/8.jpg saved to cache
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:08 [ayvens.it] INFO: Found listing with ID: 1988899
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988899%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [ayvens.it] INFO: Scrape type for 1988899: 1
2026-03-27 16:33:08 [ayvens.it] INFO: Extracting data for car ID: 1988899
2026-03-27 16:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f70c02f-da37-523c-ab8e-31b9e0f0eb35 with identifier: 1988899
2026-03-27 16:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35 with scrape type 1
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/1.jpg not downloaded yet
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b489d0>
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/9.jpg saved to cache
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/2.jpg not downloaded yet
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/3.jpg not downloaded yet
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a68e90>
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/5.jpg saved to cache
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69514510>
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/4.jpg saved to cache
2026-03-27 16:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f7590>
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/2.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b4a350>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/3.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0d810>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/1.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/4.jpg not downloaded yet
2026-03-27 16:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/5.jpg not downloaded yet
2026-03-27 16:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/6.jpg not downloaded yet
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/7.jpg not downloaded yet
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/8.jpg not downloaded yet
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/9.jpg not downloaded yet
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/10.jpg not downloaded yet
2026-03-27 16:33:09 [ayvens.it] INFO: Found listing with ID: 1988900
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988900%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [ayvens.it] INFO: Scrape type for 1988900: 1
2026-03-27 16:33:09 [ayvens.it] INFO: Extracting data for car ID: 1988900
2026-03-27 16:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8617a11-ba99-5a28-baca-d6c4ae003c5f with identifier: 1988900
2026-03-27 16:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8617a11-ba99-5a28-baca-d6c4ae003c5f with scrape type 1
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/1.jpg not downloaded yet
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f04810>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/8.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccd110>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/10.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b32fd0>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/4.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/2.jpg not downloaded yet
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936b050>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/3.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fea850>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/10.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69339950>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/6.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b4550>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/9.jpg saved to cache
2026-03-27 16:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa26c50>
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/5.jpg saved to cache
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/3.jpg not downloaded yet
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/4.jpg not downloaded yet
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/5.jpg not downloaded yet
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/6.jpg not downloaded yet
2026-03-27 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/7.jpg not downloaded yet
2026-03-27 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/8.jpg not downloaded yet
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/9.jpg not downloaded yet
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/10.jpg not downloaded yet
2026-03-27 16:33:10 [ayvens.it] INFO: Found listing with ID: 1988901
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988901%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [ayvens.it] INFO: Scrape type for 1988901: 1
2026-03-27 16:33:10 [ayvens.it] INFO: Extracting data for car ID: 1988901
2026-03-27 16:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ef93c5-7ccc-5a86-8f66-9aeef59a959f with identifier: 1988901
2026-03-27 16:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f with scrape type 1
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/1.jpg not downloaded yet
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/2.jpg not downloaded yet
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c57910>
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/7.jpg saved to cache
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853de50>
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/8.jpg saved to cache
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ade350>
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/1.jpg saved to cache
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853fe10>
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/10.jpg saved to cache
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/3.jpg not downloaded yet
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68540990>
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/9.jpg saved to cache
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb6010>
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/3.jpg saved to cache
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d12990>
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/4.jpg saved to cache
2026-03-27 16:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b89150>
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/2.jpg saved to cache
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/4.jpg not downloaded yet
2026-03-27 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/5.jpg not downloaded yet
2026-03-27 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/6.jpg not downloaded yet
2026-03-27 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/7.jpg not downloaded yet
2026-03-27 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/8.jpg not downloaded yet
2026-03-27 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/9.jpg not downloaded yet
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69019710>
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/4.jpg saved to cache
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/10.jpg not downloaded yet
2026-03-27 16:33:11 [ayvens.it] INFO: Found listing with ID: 1988902
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988902%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [ayvens.it] INFO: Scrape type for 1988902: 1
2026-03-27 16:33:11 [ayvens.it] INFO: Extracting data for car ID: 1988902
2026-03-27 16:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de312f99-923c-5d87-86b7-7cc7c0327b14 with identifier: 1988902
2026-03-27 16:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de312f99-923c-5d87-86b7-7cc7c0327b14 with scrape type 1
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/1.jpg not downloaded yet
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/2.jpg not downloaded yet
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6921d510>
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/2.jpg saved to cache
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb33d0>
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/5.jpg saved to cache
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c7b050>
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/3.jpg saved to cache
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68533010>
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/9.jpg saved to cache
2026-03-27 16:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c78ed0>
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/6.jpg saved to cache
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b1ab9d0>
2026-03-27 16:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/5.jpg saved to cache
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/3.jpg not downloaded yet
2026-03-27 16:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/4.jpg not downloaded yet
2026-03-27 16:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835f650>
2026-03-27 16:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fec158744b1ec4074b45156611f9711e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/1.jpg saved to cache
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef281b05-4a91-505d-a4ed-6514e3dd1968
2026-03-27 16:33:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef281b05-4a91-505d-a4ed-6514e3dd1968, skipping ID generation
2026-03-27 16:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef281b05-4a91-505d-a4ed-6514e3dd1968 with scrape type 1
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef281b05-4a91-505d-a4ed-6514e3dd1968 sending to next pipeline
2026-03-27 16:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ef281b05-4a91-505d-a4ed-6514e3dd1968, identifier: 1988898
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/5.jpg not downloaded yet
2026-03-27 16:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ef281b05-4a91-505d-a4ed-6514e3dd1968 with identifier: 1988898
2026-03-27 16:33:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ef281b05-4a91-505d-a4ed-6514e3dd1968 with identifier: 1988898
2026-03-27 16:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ef281b05-4a91-505d-a4ed-6514e3dd1968 with identifier: 1988898 to the API
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio manhattan metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'ef281b05-4a91-505d-a4ed-6514e3dd1968',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A4 AVANT 2.0 40 TDI BUSIN ADVAN. S TRONIC SW 5-door (Euro 6D) '
'mild hybrid',
'odometer': 157353,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 867599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810656,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 867599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 847424,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 817740,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 724662,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700326,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 737929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef281b05-4a91-505d-a4ed-6514e3dd1968/ef281b05-4a91-505d-a4ed-6514e3dd1968_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 699448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ec158744b1ec4074b45156611f9711e0/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A4 AVANT 2.0 40 TDI BUSIN ADVAN. S TRONIC SW 5-door (Euro '
'6D) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988898%27 HTTP/1.1" 200 None
2026-03-27 16:33:13 [ayvens.it] INFO: Saving data for 1988898: {'created_time': 1774629193.077217, 'last_price_update_time': 1774629193.077229, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988898') HTTP/1.1" 204 0
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/6.jpg not downloaded yet
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912ce10>
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/6.jpg saved to cache
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c10a50>
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/4.jpg saved to cache
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/7.jpg not downloaded yet
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/8.jpg not downloaded yet
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68610290>
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/5.jpg saved to cache
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b234d90>
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/2.jpg saved to cache
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/9.jpg not downloaded yet
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/10.jpg not downloaded yet
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692df290>
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/3.jpg saved to cache
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b721d0>
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/2.jpg saved to cache
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b5250>
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/1.jpg saved to cache
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af5950>
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/3.jpg saved to cache
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:13 [ayvens.it] INFO: Found listing with ID: 1988903
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988903%27 HTTP/1.1" 200 None
2026-03-27 16:33:13 [ayvens.it] INFO: Scrape type for 1988903: 1
2026-03-27 16:33:13 [ayvens.it] INFO: Extracting data for car ID: 1988903
2026-03-27 16:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c79fa7f1-f2ab-5966-b31e-db071a88263f with identifier: 1988903
2026-03-27 16:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79fa7f1-f2ab-5966-b31e-db071a88263f with scrape type 1
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/1.jpg not downloaded yet
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/2.jpg not downloaded yet
2026-03-27 16:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/3.jpg not downloaded yet
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c6110>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/4.jpg saved to cache
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/4.jpg not downloaded yet
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/5.jpg not downloaded yet
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c59d0>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/10.jpg saved to cache
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc0910>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/5.jpg saved to cache
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b2b350>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/9.jpg saved to cache
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/6.jpg not downloaded yet
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/7.jpg not downloaded yet
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/8.jpg not downloaded yet
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc3590>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/10.jpg saved to cache
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b887d0>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/8.jpg saved to cache
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcd710>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/6.jpg saved to cache
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c08ed0>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/7.jpg saved to cache
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcfa50>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/3.jpg saved to cache
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/9.jpg not downloaded yet
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/10.jpg not downloaded yet
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [ayvens.it] INFO: Found listing with ID: 1988904
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988904%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [ayvens.it] INFO: Scrape type for 1988904: 1
2026-03-27 16:33:14 [ayvens.it] INFO: Extracting data for car ID: 1988904
2026-03-27 16:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1 with identifier: 1988904
2026-03-27 16:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1 with scrape type 1
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/1.jpg not downloaded yet
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/2.jpg not downloaded yet
2026-03-27 16:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/3.jpg not downloaded yet
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18550>
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/4.jpg saved to cache
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/4.jpg not downloaded yet
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fef3d0>
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/7.jpg saved to cache
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/5.jpg not downloaded yet
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b2bf10>
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/2.jpg saved to cache
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdf050>
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/5.jpg saved to cache
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928c550>
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/6.jpg saved to cache
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b4be10>
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/1.jpg saved to cache
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69161790>
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/8.jpg saved to cache
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69302810>
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252F39cb6dc953144be09a2eb304ce6c04e9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/9.jpg saved to cache
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f
2026-03-27 16:33:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93ef93c5-7ccc-5a86-8f66-9aeef59a959f, skipping ID generation
2026-03-27 16:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f with scrape type 1
2026-03-27 16:33:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93ef93c5-7ccc-5a86-8f66-9aeef59a959f sending to next pipeline
2026-03-27 16:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 93ef93c5-7ccc-5a86-8f66-9aeef59a959f, identifier: 1988901
2026-03-27 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/6.jpg not downloaded yet
2026-03-27 16:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 93ef93c5-7ccc-5a86-8f66-9aeef59a959f with identifier: 1988901
2026-03-27 16:33:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 93ef93c5-7ccc-5a86-8f66-9aeef59a959f with identifier: 1988901
2026-03-27 16:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 93ef93c5-7ccc-5a86-8f66-9aeef59a959f with identifier: 1988901 to the API
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'electric',
'id': '93ef93c5-7ccc-5a86-8f66-9aeef59a959f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT T/P Elettrico 68KWH 184cv 350 L2H2 Trend Furgone '
'4-door',
'odometer': 29816,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640937,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437187,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ef93c5-7ccc-5a86-8f66-9aeef59a959f/93ef93c5-7ccc-5a86-8f66-9aeef59a959f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/39cb6dc953144be09a2eb304ce6c04e9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT T/P Elettrico 68KWH 184cv 350 L2H2 Trend Furgone '
'4-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988901%27 HTTP/1.1" 200 None
2026-03-27 16:33:16 [ayvens.it] INFO: Saving data for 1988901: {'created_time': 1774629196.488907, 'last_price_update_time': 1774629196.488919, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988901') HTTP/1.1" 204 0
2026-03-27 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/7.jpg not downloaded yet
2026-03-27 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/8.jpg not downloaded yet
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936a8d0>
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/3.jpg saved to cache
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/9.jpg not downloaded yet
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/10.jpg not downloaded yet
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914f1d0>
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/2.jpg saved to cache
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdfcd0>
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/9.jpg saved to cache
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b67850>
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy0%252F398e77f979634dc783a22baebb56123c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/10.jpg saved to cache
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de312f99-923c-5d87-86b7-7cc7c0327b14
2026-03-27 16:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de312f99-923c-5d87-86b7-7cc7c0327b14, skipping ID generation
2026-03-27 16:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de312f99-923c-5d87-86b7-7cc7c0327b14 with scrape type 1
2026-03-27 16:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de312f99-923c-5d87-86b7-7cc7c0327b14 sending to next pipeline
2026-03-27 16:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: de312f99-923c-5d87-86b7-7cc7c0327b14, identifier: 1988902
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69368910>
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/4.jpg saved to cache
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:17 [ayvens.it] INFO: Found listing with ID: 1988905
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988905%27 HTTP/1.1" 200 None
2026-03-27 16:33:17 [ayvens.it] INFO: Scrape type for 1988905: 1
2026-03-27 16:33:17 [ayvens.it] INFO: Extracting data for car ID: 1988905
2026-03-27 16:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with identifier: 1988905
2026-03-27 16:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with scrape type 1
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/1.jpg not downloaded yet
2026-03-27 16:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: de312f99-923c-5d87-86b7-7cc7c0327b14 with identifier: 1988902
2026-03-27 16:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: de312f99-923c-5d87-86b7-7cc7c0327b14 with identifier: 1988902
2026-03-27 16:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: de312f99-923c-5d87-86b7-7cc7c0327b14 with identifier: 1988902 to the API
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'de312f99-923c-5d87-86b7-7cc7c0327b14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT T/P 350 L4 Trend 2.0 HDT 165 cv Cabinato 2-door',
'odometer': 79000,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473455,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541951,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472875,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de312f99-923c-5d87-86b7-7cc7c0327b14/de312f99-923c-5d87-86b7-7cc7c0327b14_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy0/398e77f979634dc783a22baebb56123c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT T/P 350 L4 Trend 2.0 HDT 165 cv Cabinato 2-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2025}
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988902%27 HTTP/1.1" 200 None
2026-03-27 16:33:17 [ayvens.it] INFO: Saving data for 1988902: {'created_time': 1774629197.469827, 'last_price_update_time': 1774629197.469837, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988902') HTTP/1.1" 204 0
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/2.jpg not downloaded yet
2026-03-27 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/3.jpg not downloaded yet
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d11e50>
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/8.jpg saved to cache
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c98dd0>
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/1.jpg saved to cache
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853c750>
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/7.jpg saved to cache
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/4.jpg not downloaded yet
2026-03-27 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/5.jpg not downloaded yet
2026-03-27 16:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914e210>
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/7.jpg saved to cache
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/6.jpg not downloaded yet
2026-03-27 16:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/7.jpg not downloaded yet
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/8.jpg not downloaded yet
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af7e50>
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/9.jpg saved to cache
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb5cd0>
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/10.jpg saved to cache
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b8aa10>
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/6.jpg saved to cache
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69018610>
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/8.jpg saved to cache
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b88290>
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/2.jpg saved to cache
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/9.jpg not downloaded yet
2026-03-27 16:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/10.jpg not downloaded yet
2026-03-27 16:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b273590>
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/1.jpg saved to cache
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0f290>
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl2%252Ff9fdb2e702c3425987e0e6b378e825d7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/5.jpg saved to cache
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c79fa7f1-f2ab-5966-b31e-db071a88263f
2026-03-27 16:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c79fa7f1-f2ab-5966-b31e-db071a88263f, skipping ID generation
2026-03-27 16:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79fa7f1-f2ab-5966-b31e-db071a88263f with scrape type 1
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c79fa7f1-f2ab-5966-b31e-db071a88263f sending to next pipeline
2026-03-27 16:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c79fa7f1-f2ab-5966-b31e-db071a88263f, identifier: 1988903
2026-03-27 16:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:18 [ayvens.it] INFO: Found listing with ID: 1988906
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988906%27 HTTP/1.1" 200 None
2026-03-27 16:33:18 [ayvens.it] INFO: Scrape type for 1988906: 1
2026-03-27 16:33:18 [ayvens.it] INFO: Extracting data for car ID: 1988906
2026-03-27 16:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8742a68b-6978-5b8c-888b-c27c18056674 with identifier: 1988906
2026-03-27 16:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8742a68b-6978-5b8c-888b-c27c18056674 with scrape type 1
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/1.jpg not downloaded yet
2026-03-27 16:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c79fa7f1-f2ab-5966-b31e-db071a88263f with identifier: 1988903
2026-03-27 16:33:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c79fa7f1-f2ab-5966-b31e-db071a88263f with identifier: 1988903
2026-03-27 16:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c79fa7f1-f2ab-5966-b31e-db071a88263f with identifier: 1988903 to the API
2026-03-27 16:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ONYX BLACK MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'c79fa7f1-f2ab-5966-b31e-db071a88263f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 (PC) B4 D AWD AUTOMATICO CORE FP',
'odometer': 120348,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 60,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 699644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400736,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 766271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731753,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79fa7f1-f2ab-5966-b31e-db071a88263f/c79fa7f1-f2ab-5966-b31e-db071a88263f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352546,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl2/f9fdb2e702c3425987e0e6b378e825d7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 (PC) B4 D AWD AUTOMATICO CORE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988903%27 HTTP/1.1" 200 None
2026-03-27 16:33:19 [ayvens.it] INFO: Saving data for 1988903: {'created_time': 1774629199.520962, 'last_price_update_time': 1774629199.520972, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988903') HTTP/1.1" 204 0
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/2.jpg not downloaded yet
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/3.jpg not downloaded yet
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68faf650>
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/7.jpg saved to cache
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b49410>
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/5.jpg saved to cache
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa258d0>
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/3.jpg saved to cache
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb5090>
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/4.jpg saved to cache
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/4.jpg not downloaded yet
2026-03-27 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/5.jpg not downloaded yet
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/6.jpg not downloaded yet
2026-03-27 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecfd50>
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/10.jpg saved to cache
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bab010>
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/8.jpg saved to cache
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936be90>
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/6.jpg saved to cache
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/7.jpg not downloaded yet
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/8.jpg not downloaded yet
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/9.jpg not downloaded yet
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b48210>
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252Ff2ee0f13a9af4f27b5c0953bf4ce3040%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/1.jpg saved to cache
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8617a11-ba99-5a28-baca-d6c4ae003c5f
2026-03-27 16:33:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8617a11-ba99-5a28-baca-d6c4ae003c5f, skipping ID generation
2026-03-27 16:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8617a11-ba99-5a28-baca-d6c4ae003c5f with scrape type 1
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8617a11-ba99-5a28-baca-d6c4ae003c5f sending to next pipeline
2026-03-27 16:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e8617a11-ba99-5a28-baca-d6c4ae003c5f, identifier: 1988900
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba1c90>
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/2.jpg saved to cache
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cfb990>
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/1.jpg saved to cache
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69235b50>
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/3.jpg saved to cache
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b20410>
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/10.jpg saved to cache
2026-03-27 16:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e8617a11-ba99-5a28-baca-d6c4ae003c5f with identifier: 1988900
2026-03-27 16:33:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e8617a11-ba99-5a28-baca-d6c4ae003c5f with identifier: 1988900
2026-03-27 16:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e8617a11-ba99-5a28-baca-d6c4ae003c5f with identifier: 1988900 to the API
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'e8617a11-ba99-5a28-baca-d6c4ae003c5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.0 EcoBlue 150CV AWD ST-Line X Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 128210,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 780978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 785613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514578,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629036,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555642,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598447,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 751223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8617a11-ba99-5a28-baca-d6c4ae003c5f/e8617a11-ba99-5a28-baca-d6c4ae003c5f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/f2ee0f13a9af4f27b5c0953bf4ce3040/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.0 EcoBlue 150CV AWD ST-Line X Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988900%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [ayvens.it] INFO: Saving data for 1988900: {'created_time': 1774629201.334634, 'last_price_update_time': 1774629201.334646, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988900') HTTP/1.1" 204 0
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/10.jpg not downloaded yet
2026-03-27 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:21 [ayvens.it] INFO: Found listing with ID: 1988907
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988907%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [ayvens.it] INFO: Scrape type for 1988907: 1
2026-03-27 16:33:21 [ayvens.it] INFO: Extracting data for car ID: 1988907
2026-03-27 16:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdee08a9-57f6-5a9b-b706-c284e31883e1 with identifier: 1988907
2026-03-27 16:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdee08a9-57f6-5a9b-b706-c284e31883e1 with scrape type 1
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/1.jpg not downloaded yet
2026-03-27 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/2.jpg not downloaded yet
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/3.jpg not downloaded yet
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/4.jpg not downloaded yet
2026-03-27 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68508dd0>
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/5.jpg saved to cache
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2f250>
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/9.jpg saved to cache
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69091090>
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/4.jpg saved to cache
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928f290>
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/6.jpg saved to cache
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/5.jpg not downloaded yet
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/6.jpg not downloaded yet
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/7.jpg not downloaded yet
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f06010>
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr9%252Ff04f39b5aab64eaeb58c963c1bb27da4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/9.jpg saved to cache
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1
2026-03-27 16:33:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1, skipping ID generation
2026-03-27 16:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1 with scrape type 1
2026-03-27 16:33:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1 sending to next pipeline
2026-03-27 16:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1, identifier: 1988904
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b19150>
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/10.jpg saved to cache
2026-03-27 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcddd0>
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/7.jpg saved to cache
2026-03-27 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1 with identifier: 1988904
2026-03-27 16:33:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1 with identifier: 1988904
2026-03-27 16:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5f43c0fa-2b0b-5c65-b31e-b84c65b899b1 with identifier: 1988904 to the API
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO TEMPESTA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '5f43c0fa-2b0b-5c65-b31e-b84c65b899b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MASERATI',
'model': 'MASERATI GRECALE 2.0 300cv MHEV GT Q4 auto Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 113232,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703714,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422677,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525944,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f43c0fa-2b0b-5c65-b31e-b84c65b899b1/5f43c0fa-2b0b-5c65-b31e-b84c65b899b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr9/f04f39b5aab64eaeb58c963c1bb27da4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'MASERATI MASERATI GRECALE 2.0 300cv MHEV GT Q4 auto Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988904%27 HTTP/1.1" 200 None
2026-03-27 16:33:22 [ayvens.it] INFO: Saving data for 1988904: {'created_time': 1774629202.685441, 'last_price_update_time': 1774629202.685452, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988904') HTTP/1.1" 204 0
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/8.jpg not downloaded yet
2026-03-27 16:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/9.jpg not downloaded yet
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68509690>
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F45d789e487fa4cd1a2115e256686cff1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/8.jpg saved to cache
2026-03-27 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2
2026-03-27 16:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2, skipping ID generation
2026-03-27 16:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with scrape type 1
2026-03-27 16:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 sending to next pipeline
2026-03-27 16:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2, identifier: 1988905
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c9c10>
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/8.jpg saved to cache
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/10.jpg not downloaded yet
2026-03-27 16:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with identifier: 1988905
2026-03-27 16:33:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with identifier: 1988905
2026-03-27 16:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2cfe371e-91e8-5fb0-ae90-f650bd3514f2 with identifier: 1988905 to the API
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ISLAND BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '2cfe371e-91e8-5fb0-ae90-f650bd3514f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MINI',
'model': 'MINI COUNTRYMAN (PC) COOPER S E ALL4 AUTOMATICA FP',
'odometer': 97613,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578387,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427446,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517432,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfe371e-91e8-5fb0-ae90-f650bd3514f2/2cfe371e-91e8-5fb0-ae90-f650bd3514f2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/45d789e487fa4cd1a2115e256686cff1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'MINI MINI COUNTRYMAN (PC) COOPER S E ALL4 AUTOMATICA FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988905%27 HTTP/1.1" 200 None
2026-03-27 16:33:23 [ayvens.it] INFO: Saving data for 1988905: {'created_time': 1774629203.348163, 'last_price_update_time': 1774629203.348174, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988905') HTTP/1.1" 204 0
2026-03-27 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:23 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68607790>
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/9.jpg saved to cache
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c87690>
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/3.jpg saved to cache
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb1d10>
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/2.jpg saved to cache
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925f490>
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/7.jpg saved to cache
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69160910>
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/1.jpg saved to cache
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936a790>
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/6.jpg saved to cache
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc0b50>
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/5.jpg saved to cache
2026-03-27 16:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69369f50>
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/9.jpg saved to cache
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69160b50>
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/8.jpg saved to cache
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69163210>
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/4.jpg saved to cache
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b4b10>
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/2.jpg saved to cache
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6c672490>
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/10.jpg saved to cache
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690d1510>
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252F91384ac742004ee6919723a78b3541aa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/4.jpg saved to cache
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8742a68b-6978-5b8c-888b-c27c18056674
2026-03-27 16:33:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8742a68b-6978-5b8c-888b-c27c18056674, skipping ID generation
2026-03-27 16:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8742a68b-6978-5b8c-888b-c27c18056674 with scrape type 1
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8742a68b-6978-5b8c-888b-c27c18056674 sending to next pipeline
2026-03-27 16:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8742a68b-6978-5b8c-888b-c27c18056674, identifier: 1988906
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf7210>
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/7.jpg saved to cache
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b234cd0>
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/3.jpg saved to cache
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69237ed0>
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/7.jpg saved to cache
2026-03-27 16:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b31ed0>
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/8.jpg saved to cache
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8742a68b-6978-5b8c-888b-c27c18056674 with identifier: 1988906
2026-03-27 16:33:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8742a68b-6978-5b8c-888b-c27c18056674 with identifier: 1988906
2026-03-27 16:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8742a68b-6978-5b8c-888b-c27c18056674 with identifier: 1988906 to the API
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK PERLA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '8742a68b-6978-5b8c-888b-c27c18056674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL GRANDLAND 1.5 130cv AT8 Business Elegance Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 139623,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 961444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 732580,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 833976,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8742a68b-6978-5b8c-888b-c27c18056674/8742a68b-6978-5b8c-888b-c27c18056674_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/91384ac742004ee6919723a78b3541aa/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL GRANDLAND 1.5 130cv AT8 Business Elegance Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988906%27 HTTP/1.1" 200 None
2026-03-27 16:33:25 [ayvens.it] INFO: Saving data for 1988906: {'created_time': 1774629205.347913, 'last_price_update_time': 1774629205.34793, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988906') HTTP/1.1" 204 0
2026-03-27 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914ea90>
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/10.jpg saved to cache
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691cb6d0>
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/6.jpg saved to cache
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b8150>
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/9.jpg saved to cache
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b316650>
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn5%252F3fee3a58dca94d1bb701000b4e9894b8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/6.jpg saved to cache
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35
2026-03-27 16:33:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f70c02f-da37-523c-ab8e-31b9e0f0eb35, skipping ID generation
2026-03-27 16:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35 with scrape type 1
2026-03-27 16:33:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f70c02f-da37-523c-ab8e-31b9e0f0eb35 sending to next pipeline
2026-03-27 16:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2f70c02f-da37-523c-ab8e-31b9e0f0eb35, identifier: 1988899
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68607350>
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/7.jpg saved to cache
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5e290>
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F5d6e2524d0544f64a3c1a9f1ffc466d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/8.jpg saved to cache
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92cc3f1d-4897-546a-b857-37a8887fcab5
2026-03-27 16:33:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92cc3f1d-4897-546a-b857-37a8887fcab5, skipping ID generation
2026-03-27 16:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92cc3f1d-4897-546a-b857-37a8887fcab5 with scrape type 1
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92cc3f1d-4897-546a-b857-37a8887fcab5 sending to next pipeline
2026-03-27 16:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 92cc3f1d-4897-546a-b857-37a8887fcab5, identifier: 1988897
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b80110>
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/5.jpg saved to cache
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6af78950>
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F4b6a982d194045438d458351866228ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/1.jpg saved to cache
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdee08a9-57f6-5a9b-b706-c284e31883e1
2026-03-27 16:33:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdee08a9-57f6-5a9b-b706-c284e31883e1, skipping ID generation
2026-03-27 16:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdee08a9-57f6-5a9b-b706-c284e31883e1 with scrape type 1
2026-03-27 16:33:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdee08a9-57f6-5a9b-b706-c284e31883e1 sending to next pipeline
2026-03-27 16:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bdee08a9-57f6-5a9b-b706-c284e31883e1, identifier: 1988907
2026-03-27 16:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2f70c02f-da37-523c-ab8e-31b9e0f0eb35 with identifier: 1988899
2026-03-27 16:33:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2f70c02f-da37-523c-ab8e-31b9e0f0eb35 with identifier: 1988899
2026-03-27 16:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2f70c02f-da37-523c-ab8e-31b9e0f0eb35 with identifier: 1988899 to the API
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'STEEL GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '2f70c02f-da37-523c-ab8e-31b9e0f0eb35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROËN C3 AIRCROSS BlueHDi 110 S&S Feel',
'odometer': 61287,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343353,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561539,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f70c02f-da37-523c-ab8e-31b9e0f0eb35/2f70c02f-da37-523c-ab8e-31b9e0f0eb35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633560,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn5/3fee3a58dca94d1bb701000b4e9894b8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROËN C3 AIRCROSS BlueHDi 110 S&S Feel -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988899%27 HTTP/1.1" 200 None
2026-03-27 16:33:26 [ayvens.it] INFO: Saving data for 1988899: {'created_time': 1774629206.852047, 'last_price_update_time': 1774629206.852057, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988899') HTTP/1.1" 204 0
2026-03-27 16:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 92cc3f1d-4897-546a-b857-37a8887fcab5 with identifier: 1988897
2026-03-27 16:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 92cc3f1d-4897-546a-b857-37a8887fcab5 with identifier: 1988897
2026-03-27 16:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 92cc3f1d-4897-546a-b857-37a8887fcab5 with identifier: 1988897 to the API
2026-03-27 16:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '92cc3f1d-4897-546a-b857-37a8887fcab5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP',
'odometer': 68553,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 54,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680398,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587809,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483453,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483453,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cc3f1d-4897-546a-b857-37a8887fcab5/92cc3f1d-4897-546a-b857-37a8887fcab5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/5d6e2524d0544f64a3c1a9f1ffc466d4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988897%27 HTTP/1.1" 200 None
2026-03-27 16:33:27 [ayvens.it] INFO: Saving data for 1988897: {'created_time': 1774629207.229139, 'last_price_update_time': 1774629207.229149, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988897') HTTP/1.1" 204 0
2026-03-27 16:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bdee08a9-57f6-5a9b-b706-c284e31883e1 with identifier: 1988907
2026-03-27 16:33:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bdee08a9-57f6-5a9b-b706-c284e31883e1 with identifier: 1988907
2026-03-27 16:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bdee08a9-57f6-5a9b-b706-c284e31883e1 with identifier: 1988907 to the API
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Frozen White pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'bdee08a9-57f6-5a9b-b706-c284e31883e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT 350 L2H2 Trend 2.0 Eco MHEV 130 Cv Furgone 4-door '
'(Euro 6.2)',
'odometer': 51959,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453215,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764620,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdee08a9-57f6-5a9b-b706-c284e31883e1/bdee08a9-57f6-5a9b-b706-c284e31883e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425284,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/4b6a982d194045438d458351866228ff/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-19',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT 350 L2H2 Trend 2.0 Eco MHEV 130 Cv Furgone 4-door '
'(Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988907%27 HTTP/1.1" 200 None
2026-03-27 16:33:27 [ayvens.it] INFO: Saving data for 1988907: {'created_time': 1774629207.525263, 'last_price_update_time': 1774629207.525273, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988907') HTTP/1.1" 204 0
2026-03-27 16:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:27 [ayvens.it] INFO: Found listing with ID: 1988908
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988908%27 HTTP/1.1" 200 None
2026-03-27 16:33:27 [ayvens.it] INFO: Scrape type for 1988908: 1
2026-03-27 16:33:27 [ayvens.it] INFO: Extracting data for car ID: 1988908
2026-03-27 16:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b234bb2b-57d8-595b-9c7a-24a43c2514d8 with identifier: 1988908
2026-03-27 16:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b234bb2b-57d8-595b-9c7a-24a43c2514d8 with scrape type 1
2026-03-27 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/1.jpg not downloaded yet
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/2.jpg not downloaded yet
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f06950>
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/6.jpg saved to cache
2026-03-27 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/3.jpg not downloaded yet
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b02290>
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/5.jpg saved to cache
2026-03-27 16:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b316910>
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/6.jpg saved to cache
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0d6d0>
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252F66a832d110974097b737be7d486a93dd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/6.jpg saved to cache
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a78db80-ade9-5886-a9cb-50d548eecc28
2026-03-27 16:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a78db80-ade9-5886-a9cb-50d548eecc28, skipping ID generation
2026-03-27 16:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a78db80-ade9-5886-a9cb-50d548eecc28 with scrape type 1
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a78db80-ade9-5886-a9cb-50d548eecc28 sending to next pipeline
2026-03-27 16:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3a78db80-ade9-5886-a9cb-50d548eecc28, identifier: 1988894
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c56050>
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg2%252F708ecdc2552e43658bec17f0051a18ec%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/7.jpg saved to cache
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c82136c-c007-5181-a579-2308c1a34463
2026-03-27 16:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c82136c-c007-5181-a579-2308c1a34463, skipping ID generation
2026-03-27 16:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c82136c-c007-5181-a579-2308c1a34463 with scrape type 1
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c82136c-c007-5181-a579-2308c1a34463 sending to next pipeline
2026-03-27 16:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4c82136c-c007-5181-a579-2308c1a34463, identifier: 1988895
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba9e90>
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/7.jpg saved to cache
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690bad50>
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg4%252F7efaed3543ec4abe8fbe6a1927c9580d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/6.jpg saved to cache
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 724aa208-77a3-56ba-acee-1283ad99da0c
2026-03-27 16:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 724aa208-77a3-56ba-acee-1283ad99da0c, skipping ID generation
2026-03-27 16:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 724aa208-77a3-56ba-acee-1283ad99da0c with scrape type 1
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 724aa208-77a3-56ba-acee-1283ad99da0c sending to next pipeline
2026-03-27 16:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 724aa208-77a3-56ba-acee-1283ad99da0c, identifier: 1988896
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c23e50>
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge9%252Fd74af182a7404247a1bbeb4a8932d2d9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/5.jpg saved to cache
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff723d9f-3a4d-5560-a66a-becf39a9339d
2026-03-27 16:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff723d9f-3a4d-5560-a66a-becf39a9339d, skipping ID generation
2026-03-27 16:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff723d9f-3a4d-5560-a66a-becf39a9339d with scrape type 1
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff723d9f-3a4d-5560-a66a-becf39a9339d sending to next pipeline
2026-03-27 16:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ff723d9f-3a4d-5560-a66a-becf39a9339d, identifier: 1988893
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/4.jpg not downloaded yet
2026-03-27 16:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3a78db80-ade9-5886-a9cb-50d548eecc28 with identifier: 1988894
2026-03-27 16:33:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3a78db80-ade9-5886-a9cb-50d548eecc28 with identifier: 1988894
2026-03-27 16:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3a78db80-ade9-5886-a9cb-50d548eecc28 with identifier: 1988894 to the API
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Oryx White Perla',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '3a78db80-ade9-5886-a9cb-50d548eecc28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Style DSG Hatchback 5-door '
'(Euro 6.2)',
'odometer': 158486,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 757118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 721458,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585669,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556389,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78db80-ade9-5886-a9cb-50d548eecc28/3a78db80-ade9-5886-a9cb-50d548eecc28_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/66a832d110974097b737be7d486a93dd/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Style DSG '
'Hatchback 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988894%27 HTTP/1.1" 200 None
2026-03-27 16:33:29 [ayvens.it] INFO: Saving data for 1988894: {'created_time': 1774629209.088372, 'last_price_update_time': 1774629209.088383, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988894') HTTP/1.1" 204 0
2026-03-27 16:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4c82136c-c007-5181-a579-2308c1a34463 with identifier: 1988895
2026-03-27 16:33:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4c82136c-c007-5181-a579-2308c1a34463 with identifier: 1988895
2026-03-27 16:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4c82136c-c007-5181-a579-2308c1a34463 with identifier: 1988895 to the API
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MITHOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '4c82136c-c007-5181-a579-2308c1a34463',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A5 35 TDI S TRONIC',
'odometer': 160924,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609281,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609281,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560587,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c82136c-c007-5181-a579-2308c1a34463/4c82136c-c007-5181-a579-2308c1a34463_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg2/708ecdc2552e43658bec17f0051a18ec/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A5 35 TDI S TRONIC -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988895%27 HTTP/1.1" 200 None
2026-03-27 16:33:29 [ayvens.it] INFO: Saving data for 1988895: {'created_time': 1774629209.439283, 'last_price_update_time': 1774629209.439292, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988895') HTTP/1.1" 204 0
2026-03-27 16:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 724aa208-77a3-56ba-acee-1283ad99da0c with identifier: 1988896
2026-03-27 16:33:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 724aa208-77a3-56ba-acee-1283ad99da0c with identifier: 1988896
2026-03-27 16:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 724aa208-77a3-56ba-acee-1283ad99da0c with identifier: 1988896 to the API
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PLATINUM GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '724aa208-77a3-56ba-acee-1283ad99da0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C4 BLUEHDI 130 S&S SHINE EAT8 FP',
'odometer': 83413,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 59,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723377,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728399,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724aa208-77a3-56ba-acee-1283ad99da0c/724aa208-77a3-56ba-acee-1283ad99da0c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg4/7efaed3543ec4abe8fbe6a1927c9580d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C4 BLUEHDI 130 S&S SHINE EAT8 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988896%27 HTTP/1.1" 200 None
2026-03-27 16:33:29 [ayvens.it] INFO: Saving data for 1988896: {'created_time': 1774629209.820981, 'last_price_update_time': 1774629209.820991, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988896') HTTP/1.1" 204 0
2026-03-27 16:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ff723d9f-3a4d-5560-a66a-becf39a9339d with identifier: 1988893
2026-03-27 16:33:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ff723d9f-3a4d-5560-a66a-becf39a9339d with identifier: 1988893
2026-03-27 16:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ff723d9f-3a4d-5560-a66a-becf39a9339d with identifier: 1988893 to the API
2026-03-27 16:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO FLORET METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'ff723d9f-3a4d-5560-a66a-becf39a9339d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 40 TDI QUATTRO S TRONIC BUSINESS ADVANCE FP',
'odometer': 137744,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637508,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff723d9f-3a4d-5560-a66a-becf39a9339d/ff723d9f-3a4d-5560-a66a-becf39a9339d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge9/d74af182a7404247a1bbeb4a8932d2d9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 40 TDI QUATTRO S TRONIC BUSINESS ADVANCE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988893%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [ayvens.it] INFO: Saving data for 1988893: {'created_time': 1774629210.176004, 'last_price_update_time': 1774629210.176015, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988893') HTTP/1.1" 204 0
2026-03-27 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/5.jpg not downloaded yet
2026-03-27 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/6.jpg not downloaded yet
2026-03-27 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/7.jpg not downloaded yet
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/8.jpg not downloaded yet
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/9.jpg not downloaded yet
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/10.jpg not downloaded yet
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcc110>
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/6.jpg saved to cache
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:33:30 [ayvens.it] INFO: Found listing with ID: 1988909
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988909%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [ayvens.it] INFO: Scrape type for 1988909: 1
2026-03-27 16:33:30 [ayvens.it] INFO: Extracting data for car ID: 1988909
2026-03-27 16:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3274dd0-155e-521a-b1c2-71cb8a235c7e with identifier: 1988909
2026-03-27 16:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3274dd0-155e-521a-b1c2-71cb8a235c7e with scrape type 1
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/1.jpg not downloaded yet
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/2.jpg not downloaded yet
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/3.jpg not downloaded yet
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68480950>
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252F2838740ec7f54c2f986ada4e065daed7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/8.jpg saved to cache
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcd4e699-7403-5c66-badb-abe3997e3e7b
2026-03-27 16:33:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcd4e699-7403-5c66-badb-abe3997e3e7b, skipping ID generation
2026-03-27 16:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd4e699-7403-5c66-badb-abe3997e3e7b with scrape type 1
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcd4e699-7403-5c66-badb-abe3997e3e7b sending to next pipeline
2026-03-27 16:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fcd4e699-7403-5c66-badb-abe3997e3e7b, identifier: 1988892
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900b910>
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/8.jpg saved to cache
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692dcdd0>
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/5.jpg saved to cache
2026-03-27 16:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694da010>
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252Fd131e926f7314bf5a98ea1bfc07a9c6b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/2.jpg saved to cache
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26
2026-03-27 16:33:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8be09e15-08b7-5c81-9412-4f2b11cd7d26, skipping ID generation
2026-03-27 16:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26 with scrape type 1
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8be09e15-08b7-5c81-9412-4f2b11cd7d26 sending to next pipeline
2026-03-27 16:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8be09e15-08b7-5c81-9412-4f2b11cd7d26, identifier: 1988889
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b23410>
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/8.jpg saved to cache
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69018310>
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/9.jpg saved to cache
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68541790>
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fd14b5bb36f78417fa3d646cf4c14dd46%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/10.jpg saved to cache
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0c058ac-4530-5440-b7c1-3f58201f4436
2026-03-27 16:33:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0c058ac-4530-5440-b7c1-3f58201f4436, skipping ID generation
2026-03-27 16:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c058ac-4530-5440-b7c1-3f58201f4436 with scrape type 1
2026-03-27 16:33:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0c058ac-4530-5440-b7c1-3f58201f4436 sending to next pipeline
2026-03-27 16:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c0c058ac-4530-5440-b7c1-3f58201f4436, identifier: 1988891
2026-03-27 16:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fcd4e699-7403-5c66-badb-abe3997e3e7b with identifier: 1988892
2026-03-27 16:33:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fcd4e699-7403-5c66-badb-abe3997e3e7b with identifier: 1988892
2026-03-27 16:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fcd4e699-7403-5c66-badb-abe3997e3e7b with identifier: 1988892 to the API
2026-03-27 16:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blu Mediterraneo pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'fcd4e699-7403-5c66-badb-abe3997e3e7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KAROQ 2.0 TDI 85KW EVO SCR EXECUTIVE DSG Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 179929,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 42,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 815271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 815271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 818354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 772519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 721758,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 612372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcd4e699-7403-5c66-badb-abe3997e3e7b/fcd4e699-7403-5c66-badb-abe3997e3e7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/2838740ec7f54c2f986ada4e065daed7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KAROQ 2.0 TDI 85KW EVO SCR EXECUTIVE DSG Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988892%27 HTTP/1.1" 200 None
2026-03-27 16:33:32 [ayvens.it] INFO: Saving data for 1988892: {'created_time': 1774629212.235705, 'last_price_update_time': 1774629212.235716, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988892') HTTP/1.1" 204 0
2026-03-27 16:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8be09e15-08b7-5c81-9412-4f2b11cd7d26 with identifier: 1988889
2026-03-27 16:33:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8be09e15-08b7-5c81-9412-4f2b11cd7d26 with identifier: 1988889
2026-03-27 16:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8be09e15-08b7-5c81-9412-4f2b11cd7d26 with identifier: 1988889 to the API
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero Mythos metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '8be09e15-08b7-5c81-9412-4f2b11cd7d26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 35 TDI S tronic Business Sport utility vehicle 5-door (Euro '
'6.2)',
'odometer': 74714,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 61,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561798,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be09e15-08b7-5c81-9412-4f2b11cd7d26/8be09e15-08b7-5c81-9412-4f2b11cd7d26_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/d131e926f7314bf5a98ea1bfc07a9c6b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 35 TDI S tronic Business Sport utility vehicle 5-door '
'(Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988889%27 HTTP/1.1" 200 None
2026-03-27 16:33:32 [ayvens.it] INFO: Saving data for 1988889: {'created_time': 1774629212.587162, 'last_price_update_time': 1774629212.587173, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988889') HTTP/1.1" 204 0
2026-03-27 16:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c0c058ac-4530-5440-b7c1-3f58201f4436 with identifier: 1988891
2026-03-27 16:33:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c0c058ac-4530-5440-b7c1-3f58201f4436 with identifier: 1988891
2026-03-27 16:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c0c058ac-4530-5440-b7c1-3f58201f4436 with identifier: 1988891 to the API
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'c0c058ac-4530-5440-b7c1-3f58201f4436',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 2008 PureTech 130 EAT8 Active Pack S/S aut. Cross over '
'5-door (Euro 6D)',
'odometer': 50145,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 62,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 838200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 833234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 838200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 715080,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 807219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 769391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509697,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695757,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c058ac-4530-5440-b7c1-3f58201f4436/c0c058ac-4530-5440-b7c1-3f58201f4436_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/d14b5bb36f78417fa3d646cf4c14dd46/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 2008 PureTech 130 EAT8 Active Pack S/S aut. Cross '
'over 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988891%27 HTTP/1.1" 200 None
2026-03-27 16:33:32 [ayvens.it] INFO: Saving data for 1988891: {'created_time': 1774629212.93256, 'last_price_update_time': 1774629212.932574, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988891') HTTP/1.1" 204 0
2026-03-27 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/4.jpg not downloaded yet
2026-03-27 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/5.jpg not downloaded yet
2026-03-27 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/6.jpg not downloaded yet
2026-03-27 16:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/7.jpg not downloaded yet
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/8.jpg not downloaded yet
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/9.jpg not downloaded yet
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0ef50>
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/10.jpg saved to cache
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/10.jpg not downloaded yet
2026-03-27 16:33:33 [ayvens.it] INFO: Found listing with ID: 1988910
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988910%27 HTTP/1.1" 200 None
2026-03-27 16:33:33 [ayvens.it] INFO: Scrape type for 1988910: 1
2026-03-27 16:33:33 [ayvens.it] INFO: Extracting data for car ID: 1988910
2026-03-27 16:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af60076f-7b2a-5ee2-aa7f-31347f615641 with identifier: 1988910
2026-03-27 16:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af60076f-7b2a-5ee2-aa7f-31347f615641 with scrape type 1
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/1.jpg not downloaded yet
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/2.jpg not downloaded yet
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e7510>
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/9.jpg saved to cache
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690bb7d0>
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/7.jpg saved to cache
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6901afd0>
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/8.jpg saved to cache
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c0a690>
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/7.jpg saved to cache
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c0b490>
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F0b68a0c16cb745e2b71152fbb079b7e2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/8.jpg saved to cache
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c610390-ec4a-5f7b-9302-f31033033fa0
2026-03-27 16:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c610390-ec4a-5f7b-9302-f31033033fa0, skipping ID generation
2026-03-27 16:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c610390-ec4a-5f7b-9302-f31033033fa0 with scrape type 1
2026-03-27 16:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c610390-ec4a-5f7b-9302-f31033033fa0 sending to next pipeline
2026-03-27 16:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6c610390-ec4a-5f7b-9302-f31033033fa0, identifier: 1988887
2026-03-27 16:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bdbb90>
2026-03-27 16:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc4%252F5e927ef3536e460f829b2231b4d032b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/8.jpg saved to cache
2026-03-27 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09
2026-03-27 16:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09, skipping ID generation
2026-03-27 16:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09 with scrape type 1
2026-03-27 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09 sending to next pipeline
2026-03-27 16:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09, identifier: 1988886
2026-03-27 16:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c5dd0>
2026-03-27 16:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252Fe557e544cc5a48e9baa4538ff4089f42%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/6.jpg saved to cache
2026-03-27 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589
2026-03-27 16:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 481b2935-1c7f-52e2-8e29-d3c3ff19a589, skipping ID generation
2026-03-27 16:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589 with scrape type 1
2026-03-27 16:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 481b2935-1c7f-52e2-8e29-d3c3ff19a589 sending to next pipeline
2026-03-27 16:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 481b2935-1c7f-52e2-8e29-d3c3ff19a589, identifier: 1988888
2026-03-27 16:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6c610390-ec4a-5f7b-9302-f31033033fa0 with identifier: 1988887
2026-03-27 16:33:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6c610390-ec4a-5f7b-9302-f31033033fa0 with identifier: 1988887
2026-03-27 16:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6c610390-ec4a-5f7b-9302-f31033033fa0 with identifier: 1988887 to the API
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol_lpg',
'id': '6c610390-ec4a-5f7b-9302-f31033033fa0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP',
'odometer': 37502,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680956,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680956,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650815,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587622,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640713,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c610390-ec4a-5f7b-9302-f31033033fa0/6c610390-ec4a-5f7b-9302-f31033033fa0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/0b68a0c16cb745e2b71152fbb079b7e2/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988887%27 HTTP/1.1" 200 None
2026-03-27 16:33:34 [ayvens.it] INFO: Saving data for 1988887: {'created_time': 1774629214.756649, 'last_price_update_time': 1774629214.756659, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988887') HTTP/1.1" 204 0
2026-03-27 16:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09 with identifier: 1988886
2026-03-27 16:33:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09 with identifier: 1988886
2026-03-27 16:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 54d8dea3-ce4a-582a-9a82-35c2d9f0bf09 with identifier: 1988886 to the API
2026-03-27 16:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Black Sapphire',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '54d8dea3-ce4a-582a-9a82-35c2d9f0bf09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X3 xDrive 30e xLine Sport utility vehicle 5-door (Euro 6.2)',
'odometer': 59114,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 740605,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649087,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595825,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650725,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d8dea3-ce4a-582a-9a82-35c2d9f0bf09/54d8dea3-ce4a-582a-9a82-35c2d9f0bf09_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc4/5e927ef3536e460f829b2231b4d032b2/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X3 xDrive 30e xLine Sport utility vehicle 5-door (Euro 6.2) '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988886%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [ayvens.it] INFO: Saving data for 1988886: {'created_time': 1774629215.167395, 'last_price_update_time': 1774629215.167405, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988886') HTTP/1.1" 204 0
2026-03-27 16:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 481b2935-1c7f-52e2-8e29-d3c3ff19a589 with identifier: 1988888
2026-03-27 16:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 481b2935-1c7f-52e2-8e29-d3c3ff19a589 with identifier: 1988888
2026-03-27 16:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 481b2935-1c7f-52e2-8e29-d3c3ff19a589 with identifier: 1988888 to the API
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO FLORET METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '481b2935-1c7f-52e2-8e29-d3c3ff19a589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 40 TDI QUATTRO S TRONIC BUSINESS ADVANCE FP',
'odometer': 105173,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 773132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696388,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651273,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 724989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_481b2935-1c7f-52e2-8e29-d3c3ff19a589/481b2935-1c7f-52e2-8e29-d3c3ff19a589_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/e557e544cc5a48e9baa4538ff4089f42/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 40 TDI QUATTRO S TRONIC BUSINESS ADVANCE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988888%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [ayvens.it] INFO: Saving data for 1988888: {'created_time': 1774629215.493415, 'last_price_update_time': 1774629215.493426, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988888') HTTP/1.1" 204 0
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/3.jpg not downloaded yet
2026-03-27 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/4.jpg not downloaded yet
2026-03-27 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/5.jpg not downloaded yet
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/6.jpg not downloaded yet
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/7.jpg not downloaded yet
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/8.jpg not downloaded yet
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/9.jpg not downloaded yet
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1e950>
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/1.jpg saved to cache
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68531b50>
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/3.jpg saved to cache
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692de3d0>
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/9.jpg saved to cache
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69302690>
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/2.jpg saved to cache
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/10.jpg not downloaded yet
2026-03-27 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685422d0>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/1.jpg saved to cache
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc14d0>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/4.jpg saved to cache
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3e810>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/10.jpg saved to cache
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d23810>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/5.jpg saved to cache
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:36 [ayvens.it] INFO: Found listing with ID: 1988911
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988911%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [ayvens.it] INFO: Scrape type for 1988911: 1
2026-03-27 16:33:36 [ayvens.it] INFO: Extracting data for car ID: 1988911
2026-03-27 16:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e0f1b52-cd79-5907-a504-d03ce3217f5f with identifier: 1988911
2026-03-27 16:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f with scrape type 1
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/1.jpg not downloaded yet
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/2.jpg not downloaded yet
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7d710>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/2.jpg saved to cache
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/3.jpg not downloaded yet
2026-03-27 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/4.jpg not downloaded yet
2026-03-27 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/5.jpg not downloaded yet
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/6.jpg not downloaded yet
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/7.jpg not downloaded yet
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/8.jpg not downloaded yet
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/9.jpg not downloaded yet
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c104d0>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/4.jpg saved to cache
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc3150>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/3.jpg saved to cache
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/10.jpg not downloaded yet
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69090290>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/5.jpg saved to cache
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2f8d0>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/10.jpg saved to cache
2026-03-27 16:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68542950>
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/6.jpg saved to cache
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912ffd0>
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/7.jpg saved to cache
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:37 [ayvens.it] INFO: Found listing with ID: 1988912
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988912%27 HTTP/1.1" 200 None
2026-03-27 16:33:37 [ayvens.it] INFO: Scrape type for 1988912: 1
2026-03-27 16:33:37 [ayvens.it] INFO: Extracting data for car ID: 1988912
2026-03-27 16:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aec951e5-0951-511c-9678-c638780da3e3 with identifier: 1988912
2026-03-27 16:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec951e5-0951-511c-9678-c638780da3e3 with scrape type 1
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/1.jpg not downloaded yet
2026-03-27 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/2.jpg not downloaded yet
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff6650>
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf1%252Feeceecbac01446f58406b9fe24121b09%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/8.jpg saved to cache
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b234bb2b-57d8-595b-9c7a-24a43c2514d8
2026-03-27 16:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b234bb2b-57d8-595b-9c7a-24a43c2514d8, skipping ID generation
2026-03-27 16:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b234bb2b-57d8-595b-9c7a-24a43c2514d8 with scrape type 1
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b234bb2b-57d8-595b-9c7a-24a43c2514d8 sending to next pipeline
2026-03-27 16:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b234bb2b-57d8-595b-9c7a-24a43c2514d8, identifier: 1988908
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b234c10>
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/3.jpg saved to cache
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b234bb2b-57d8-595b-9c7a-24a43c2514d8 with identifier: 1988908
2026-03-27 16:33:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b234bb2b-57d8-595b-9c7a-24a43c2514d8 with identifier: 1988908
2026-03-27 16:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b234bb2b-57d8-595b-9c7a-24a43c2514d8 with identifier: 1988908 to the API
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO BANQUISE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'b234bb2b-57d8-595b-9c7a-24a43c2514d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 BLUEHDI 100 S&S FEEL VAN FP',
'odometer': 140048,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480867,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480867,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508026,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543196,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505410,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b234bb2b-57d8-595b-9c7a-24a43c2514d8/b234bb2b-57d8-595b-9c7a-24a43c2514d8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf1/eeceecbac01446f58406b9fe24121b09/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 BLUEHDI 100 S&S FEEL VAN FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988908%27 HTTP/1.1" 200 None
2026-03-27 16:33:37 [ayvens.it] INFO: Saving data for 1988908: {'created_time': 1774629217.870999, 'last_price_update_time': 1774629217.871014, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988908') HTTP/1.1" 204 0
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/3.jpg not downloaded yet
2026-03-27 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/4.jpg not downloaded yet
2026-03-27 16:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914cf10>
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/7.jpg saved to cache
2026-03-27 16:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912f050>
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc2%252F9b4dac182b4146ec9c17015449070c26%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/7.jpg saved to cache
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81
2026-03-27 16:33:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81, skipping ID generation
2026-03-27 16:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81 with scrape type 1
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81 sending to next pipeline
2026-03-27 16:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81, identifier: 1988885
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e6890>
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/8.jpg saved to cache
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69045050>
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/6.jpg saved to cache
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/5.jpg not downloaded yet
2026-03-27 16:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81 with identifier: 1988885
2026-03-27 16:33:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81 with identifier: 1988885
2026-03-27 16:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 93cbea5b-fd54-52f0-b7d8-619f4a4a3d81 with identifier: 1988885 to the API
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Glacier Silver metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '93cbea5b-fd54-52f0-b7d8-619f4a4a3d81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 sDrive 18d Business Advantage Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 67062,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 74,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535988,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544181,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604178,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cbea5b-fd54-52f0-b7d8-619f4a4a3d81/93cbea5b-fd54-52f0-b7d8-619f4a4a3d81_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514405,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc2/9b4dac182b4146ec9c17015449070c26/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 sDrive 18d Business Advantage Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988885%27 HTTP/1.1" 200 None
2026-03-27 16:33:38 [ayvens.it] INFO: Saving data for 1988885: {'created_time': 1774629218.772421, 'last_price_update_time': 1774629218.772438, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988885') HTTP/1.1" 204 0
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/6.jpg not downloaded yet
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b49650>
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252Fcaded3062bdb40e9a6f6e119393f2250%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/9.jpg saved to cache
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3274dd0-155e-521a-b1c2-71cb8a235c7e
2026-03-27 16:33:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3274dd0-155e-521a-b1c2-71cb8a235c7e, skipping ID generation
2026-03-27 16:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3274dd0-155e-521a-b1c2-71cb8a235c7e with scrape type 1
2026-03-27 16:33:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3274dd0-155e-521a-b1c2-71cb8a235c7e sending to next pipeline
2026-03-27 16:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e3274dd0-155e-521a-b1c2-71cb8a235c7e, identifier: 1988909
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba2590>
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/1.jpg saved to cache
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69235d50>
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/2.jpg saved to cache
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e3274dd0-155e-521a-b1c2-71cb8a235c7e with identifier: 1988909
2026-03-27 16:33:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e3274dd0-155e-521a-b1c2-71cb8a235c7e with identifier: 1988909
2026-03-27 16:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e3274dd0-155e-521a-b1c2-71cb8a235c7e with identifier: 1988909 to the API
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Gelato pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'e3274dd0-155e-521a-b1c2-71cb8a235c7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500X 1.3 Mjet 95cv E6D Club Cross over 5-door (Euro 6D)',
'odometer': 117704,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 74,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187972,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428680,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517920,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295842,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435714,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3274dd0-155e-521a-b1c2-71cb8a235c7e/e3274dd0-155e-521a-b1c2-71cb8a235c7e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439340,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/caded3062bdb40e9a6f6e119393f2250/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500X 1.3 Mjet 95cv E6D Club Cross over 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988909%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [ayvens.it] INFO: Saving data for 1988909: {'created_time': 1774629219.531332, 'last_price_update_time': 1774629219.531341, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988909') HTTP/1.1" 204 0
2026-03-27 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/7.jpg not downloaded yet
2026-03-27 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/8.jpg not downloaded yet
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/9.jpg not downloaded yet
2026-03-27 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/10.jpg not downloaded yet
2026-03-27 16:33:39 [ayvens.it] INFO: Found listing with ID: 1988913
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988913%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [ayvens.it] INFO: Scrape type for 1988913: 1
2026-03-27 16:33:39 [ayvens.it] INFO: Extracting data for car ID: 1988913
2026-03-27 16:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8114194-e648-5593-8945-aba28a51701c with identifier: 1988913
2026-03-27 16:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8114194-e648-5593-8945-aba28a51701c with scrape type 1
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/1.jpg not downloaded yet
2026-03-27 16:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/2.jpg not downloaded yet
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b56dd0>
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/9.jpg saved to cache
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69325c50>
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/8.jpg saved to cache
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/3.jpg not downloaded yet
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1df50>
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/10.jpg saved to cache
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/4.jpg not downloaded yet
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/5.jpg not downloaded yet
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690d0410>
2026-03-27 16:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/1.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1c110>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/2.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1ed90>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/7.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ec590>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/6.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68adc090>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/3.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/6.jpg not downloaded yet
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/7.jpg not downloaded yet
2026-03-27 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/8.jpg not downloaded yet
2026-03-27 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/9.jpg not downloaded yet
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/10.jpg not downloaded yet
2026-03-27 16:33:40 [ayvens.it] INFO: Found listing with ID: 1988914
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988914%27 HTTP/1.1" 200 None
2026-03-27 16:33:40 [ayvens.it] INFO: Scrape type for 1988914: 1
2026-03-27 16:33:40 [ayvens.it] INFO: Extracting data for car ID: 1988914
2026-03-27 16:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ee61d1a-f235-5fd7-9a98-347822e652ca with identifier: 1988914
2026-03-27 16:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee61d1a-f235-5fd7-9a98-347822e652ca with scrape type 1
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/1.jpg not downloaded yet
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/2.jpg not downloaded yet
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc8290>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/1.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b70310>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/8.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923d0d0>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/2.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694db290>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/3.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d37dd0>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/7.jpg saved to cache
2026-03-27 16:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d8790>
2026-03-27 16:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/10.jpg saved to cache
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/3.jpg not downloaded yet
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bab050>
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/6.jpg saved to cache
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690d2810>
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/9.jpg saved to cache
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/4.jpg not downloaded yet
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/5.jpg not downloaded yet
2026-03-27 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/6.jpg not downloaded yet
2026-03-27 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/7.jpg not downloaded yet
2026-03-27 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/8.jpg not downloaded yet
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/9.jpg not downloaded yet
2026-03-27 16:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/10.jpg not downloaded yet
2026-03-27 16:33:41 [ayvens.it] INFO: Found listing with ID: 1988915
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988915%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [ayvens.it] INFO: Scrape type for 1988915: 1
2026-03-27 16:33:41 [ayvens.it] INFO: Extracting data for car ID: 1988915
2026-03-27 16:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b7bffa-a3be-5a18-ae7f-94cac8849250 with identifier: 1988915
2026-03-27 16:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b7bffa-a3be-5a18-ae7f-94cac8849250 with scrape type 1
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/1.jpg not downloaded yet
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/2.jpg not downloaded yet
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6850a090>
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/9.jpg saved to cache
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a6af50>
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/6.jpg saved to cache
2026-03-27 16:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914ca50>
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/7.jpg saved to cache
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1e210>
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/5.jpg saved to cache
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69517b50>
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/4.jpg saved to cache
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b7dd0>
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/3.jpg saved to cache
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69515690>
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/8.jpg saved to cache
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/3.jpg not downloaded yet
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e786d8c10>
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/5.jpg saved to cache
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/4.jpg not downloaded yet
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/5.jpg not downloaded yet
2026-03-27 16:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/6.jpg not downloaded yet
2026-03-27 16:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/7.jpg not downloaded yet
2026-03-27 16:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/8.jpg not downloaded yet
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/9.jpg not downloaded yet
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/10.jpg not downloaded yet
2026-03-27 16:33:42 [ayvens.it] INFO: Found listing with ID: 1988916
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988916%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [ayvens.it] INFO: Scrape type for 1988916: 1
2026-03-27 16:33:42 [ayvens.it] INFO: Extracting data for car ID: 1988916
2026-03-27 16:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b89a5c-db75-53c7-b7d2-95be3b735736 with identifier: 1988916
2026-03-27 16:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b89a5c-db75-53c7-b7d2-95be3b735736 with scrape type 1
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/1.jpg not downloaded yet
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923cd10>
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/4.jpg saved to cache
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18e10>
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/7.jpg saved to cache
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/2.jpg not downloaded yet
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/3.jpg not downloaded yet
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fedc90>
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/5.jpg saved to cache
2026-03-27 16:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd44d0>
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/2.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b495d0>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/3.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68455890>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/1.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69140d50>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/6.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68456fd0>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/2.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/4.jpg not downloaded yet
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/5.jpg not downloaded yet
2026-03-27 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/6.jpg not downloaded yet
2026-03-27 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/7.jpg not downloaded yet
2026-03-27 16:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/8.jpg not downloaded yet
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/9.jpg not downloaded yet
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/10.jpg not downloaded yet
2026-03-27 16:33:43 [ayvens.it] INFO: Found listing with ID: 1988917
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988917%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [ayvens.it] INFO: Scrape type for 1988917: 1
2026-03-27 16:33:43 [ayvens.it] INFO: Extracting data for car ID: 1988917
2026-03-27 16:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54426166-0f01-5a56-aa6d-822b7777a3e8 with identifier: 1988917
2026-03-27 16:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54426166-0f01-5a56-aa6d-822b7777a3e8 with scrape type 1
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/1.jpg not downloaded yet
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fac950>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/5.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2890>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/10.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/2.jpg not downloaded yet
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f98150>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/4.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e7964ae50>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/7.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69140dd0>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/3.jpg saved to cache
2026-03-27 16:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2f950>
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/9.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f2610>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/6.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa25210>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/1.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/3.jpg not downloaded yet
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/4.jpg not downloaded yet
2026-03-27 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/5.jpg not downloaded yet
2026-03-27 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/6.jpg not downloaded yet
2026-03-27 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/7.jpg not downloaded yet
2026-03-27 16:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/8.jpg not downloaded yet
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/9.jpg not downloaded yet
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/10.jpg not downloaded yet
2026-03-27 16:33:44 [ayvens.it] INFO: Found listing with ID: 1988918
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988918%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [ayvens.it] INFO: Scrape type for 1988918: 1
2026-03-27 16:33:44 [ayvens.it] INFO: Extracting data for car ID: 1988918
2026-03-27 16:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c49a34-20bd-5aee-b2fa-e77d50dfa71e with identifier: 1988918
2026-03-27 16:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e with scrape type 1
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/1.jpg not downloaded yet
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68612710>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/5.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/2.jpg not downloaded yet
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69140410>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/6.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecd9d0>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/4.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdeb50>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/2.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c9ad0>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/1.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6a9ffa50>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/10.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5d450>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/9.jpg saved to cache
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/3.jpg not downloaded yet
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/4.jpg not downloaded yet
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690d3310>
2026-03-27 16:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/2.jpg saved to cache
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/5.jpg not downloaded yet
2026-03-27 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/6.jpg not downloaded yet
2026-03-27 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/7.jpg not downloaded yet
2026-03-27 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/8.jpg not downloaded yet
2026-03-27 16:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/9.jpg not downloaded yet
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/10.jpg not downloaded yet
2026-03-27 16:33:45 [ayvens.it] INFO: Found listing with ID: 1988919
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988919%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [ayvens.it] INFO: Scrape type for 1988919: 1
2026-03-27 16:33:45 [ayvens.it] INFO: Extracting data for car ID: 1988919
2026-03-27 16:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f693b8-1adf-5742-bc0b-f7952cdae442 with identifier: 1988919
2026-03-27 16:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f693b8-1adf-5742-bc0b-f7952cdae442 with scrape type 1
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/1.jpg not downloaded yet
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/2.jpg not downloaded yet
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b284d0>
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/10.jpg saved to cache
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cf8cd0>
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/9.jpg saved to cache
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68956810>
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/2.jpg saved to cache
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2f050>
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/1.jpg saved to cache
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914c310>
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/4.jpg saved to cache
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/3.jpg not downloaded yet
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b88cd0>
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/3.jpg saved to cache
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d10710>
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/5.jpg saved to cache
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/4.jpg not downloaded yet
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba0110>
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/1.jpg saved to cache
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/5.jpg not downloaded yet
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/6.jpg not downloaded yet
2026-03-27 16:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/7.jpg not downloaded yet
2026-03-27 16:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/8.jpg not downloaded yet
2026-03-27 16:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/9.jpg not downloaded yet
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/10.jpg not downloaded yet
2026-03-27 16:33:46 [ayvens.it] INFO: Found listing with ID: 1988920
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988920%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [ayvens.it] INFO: Scrape type for 1988920: 1
2026-03-27 16:33:46 [ayvens.it] INFO: Extracting data for car ID: 1988920
2026-03-27 16:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c998a9d-60a0-500d-97b6-eda95605138f with identifier: 1988920
2026-03-27 16:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c998a9d-60a0-500d-97b6-eda95605138f with scrape type 1
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/1.jpg not downloaded yet
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/2.jpg not downloaded yet
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba2610>
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/4.jpg saved to cache
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69029050>
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/10.jpg saved to cache
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936b610>
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/5.jpg saved to cache
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6902a950>
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/8.jpg saved to cache
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68454cd0>
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/6.jpg saved to cache
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c09410>
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/2.jpg saved to cache
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/3.jpg not downloaded yet
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e698eac10>
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/3.jpg saved to cache
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684fb190>
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/9.jpg saved to cache
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/4.jpg not downloaded yet
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/5.jpg not downloaded yet
2026-03-27 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/6.jpg not downloaded yet
2026-03-27 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/7.jpg not downloaded yet
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/8.jpg not downloaded yet
2026-03-27 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/9.jpg not downloaded yet
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/10.jpg not downloaded yet
2026-03-27 16:33:47 [ayvens.it] INFO: Found listing with ID: 1988921
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988921%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [ayvens.it] INFO: Scrape type for 1988921: 1
2026-03-27 16:33:47 [ayvens.it] INFO: Extracting data for car ID: 1988921
2026-03-27 16:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e with identifier: 1988921
2026-03-27 16:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e with scrape type 1
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/1.jpg not downloaded yet
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/2.jpg not downloaded yet
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3db10>
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/1.jpg saved to cache
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68544890>
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/4.jpg saved to cache
2026-03-27 16:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fed190>
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/3.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b69d0>
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/6.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68544590>
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/5.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/3.jpg not downloaded yet
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68add390>
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/3.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6860b350>
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/1.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f7810>
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/2.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/4.jpg not downloaded yet
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/5.jpg not downloaded yet
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/6.jpg not downloaded yet
2026-03-27 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/7.jpg not downloaded yet
2026-03-27 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/8.jpg not downloaded yet
2026-03-27 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/9.jpg not downloaded yet
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/10.jpg not downloaded yet
2026-03-27 16:33:48 [ayvens.it] INFO: Found listing with ID: 1988922
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988922%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [ayvens.it] INFO: Scrape type for 1988922: 1
2026-03-27 16:33:48 [ayvens.it] INFO: Extracting data for car ID: 1988922
2026-03-27 16:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 672d93f8-e491-5d9a-a1c3-e6257488a356 with identifier: 1988922
2026-03-27 16:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672d93f8-e491-5d9a-a1c3-e6257488a356 with scrape type 1
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/1.jpg not downloaded yet
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/2.jpg not downloaded yet
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af6550>
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/9.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684fa910>
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/10.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1dfd0>
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/8.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916f650>
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/7.jpg saved to cache
2026-03-27 16:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/3.jpg not downloaded yet
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853e4d0>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/8.jpg saved to cache
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/4.jpg not downloaded yet
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/5.jpg not downloaded yet
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb1090>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/4.jpg saved to cache
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1db50>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/5.jpg saved to cache
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdea50>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/6.jpg saved to cache
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/6.jpg not downloaded yet
2026-03-27 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/7.jpg not downloaded yet
2026-03-27 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/8.jpg not downloaded yet
2026-03-27 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/9.jpg not downloaded yet
2026-03-27 16:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/10.jpg not downloaded yet
2026-03-27 16:33:49 [ayvens.it] INFO: Found listing with ID: 1988923
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988923%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [ayvens.it] INFO: Scrape type for 1988923: 1
2026-03-27 16:33:49 [ayvens.it] INFO: Extracting data for car ID: 1988923
2026-03-27 16:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92894306-eabc-56a1-afdc-298c40030e71 with identifier: 1988923
2026-03-27 16:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92894306-eabc-56a1-afdc-298c40030e71 with scrape type 1
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/1.jpg not downloaded yet
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ba8b990>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/5.jpg saved to cache
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/2.jpg not downloaded yet
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912e6d0>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/7.jpg saved to cache
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69355fd0>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/6.jpg saved to cache
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68609ed0>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/4.jpg saved to cache
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f05b50>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/3.jpg saved to cache
2026-03-27 16:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc3d10>
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/2.jpg saved to cache
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/3.jpg not downloaded yet
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/4.jpg not downloaded yet
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68542350>
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/3.jpg saved to cache
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b4250>
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/2.jpg saved to cache
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/5.jpg not downloaded yet
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/6.jpg not downloaded yet
2026-03-27 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/7.jpg not downloaded yet
2026-03-27 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/8.jpg not downloaded yet
2026-03-27 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/9.jpg not downloaded yet
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/10.jpg not downloaded yet
2026-03-27 16:33:50 [ayvens.it] INFO: Found listing with ID: 1988924
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988924%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [ayvens.it] INFO: Scrape type for 1988924: 1
2026-03-27 16:33:50 [ayvens.it] INFO: Extracting data for car ID: 1988924
2026-03-27 16:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with identifier: 1988924
2026-03-27 16:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with scrape type 1
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/1.jpg not downloaded yet
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/2.jpg not downloaded yet
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c97d0>
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/6.jpg saved to cache
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922d950>
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/1.jpg saved to cache
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c7010>
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/3.jpg saved to cache
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5ae90>
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/4.jpg saved to cache
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdfed0>
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/1.jpg saved to cache
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691cbe50>
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/5.jpg saved to cache
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/3.jpg not downloaded yet
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68456310>
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/2.jpg saved to cache
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e4510>
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/10.jpg saved to cache
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/4.jpg not downloaded yet
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/5.jpg not downloaded yet
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/6.jpg not downloaded yet
2026-03-27 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/7.jpg not downloaded yet
2026-03-27 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/8.jpg not downloaded yet
2026-03-27 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/9.jpg not downloaded yet
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/10.jpg not downloaded yet
2026-03-27 16:33:51 [ayvens.it] INFO: Found listing with ID: 1988925
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988925%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [ayvens.it] INFO: Scrape type for 1988925: 1
2026-03-27 16:33:51 [ayvens.it] INFO: Extracting data for car ID: 1988925
2026-03-27 16:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with identifier: 1988925
2026-03-27 16:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with scrape type 1
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/1.jpg not downloaded yet
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/2.jpg not downloaded yet
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914ed10>
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/7.jpg saved to cache
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1e410>
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/6.jpg saved to cache
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0c550>
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/4.jpg saved to cache
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/3.jpg not downloaded yet
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835d650>
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/5.jpg saved to cache
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68faee90>
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/1.jpg saved to cache
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/4.jpg not downloaded yet
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/5.jpg not downloaded yet
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68faec90>
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/2.jpg saved to cache
2026-03-27 16:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fe9450>
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/8.jpg saved to cache
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fca0d0>
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/9.jpg saved to cache
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/6.jpg not downloaded yet
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/7.jpg not downloaded yet
2026-03-27 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/8.jpg not downloaded yet
2026-03-27 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/9.jpg not downloaded yet
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/10.jpg not downloaded yet
2026-03-27 16:33:52 [ayvens.it] INFO: Found listing with ID: 1988926
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988926%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [ayvens.it] INFO: Scrape type for 1988926: 1
2026-03-27 16:33:52 [ayvens.it] INFO: Extracting data for car ID: 1988926
2026-03-27 16:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with identifier: 1988926
2026-03-27 16:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with scrape type 1
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/1.jpg not downloaded yet
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/2.jpg not downloaded yet
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d20190>
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/9.jpg saved to cache
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68febd90>
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/3.jpg saved to cache
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/3.jpg not downloaded yet
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcc990>
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/6.jpg saved to cache
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c23ad0>
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/10.jpg saved to cache
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fac110>
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/4.jpg saved to cache
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c23210>
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/5.jpg saved to cache
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/4.jpg not downloaded yet
2026-03-27 16:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/5.jpg not downloaded yet
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdc2d0>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/1.jpg saved to cache
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcce50>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/2.jpg saved to cache
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/6.jpg not downloaded yet
2026-03-27 16:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/7.jpg not downloaded yet
2026-03-27 16:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/8.jpg not downloaded yet
2026-03-27 16:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/9.jpg not downloaded yet
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/10.jpg not downloaded yet
2026-03-27 16:33:53 [ayvens.it] INFO: Found listing with ID: 1988927
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988927%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [ayvens.it] INFO: Scrape type for 1988927: 1
2026-03-27 16:33:53 [ayvens.it] INFO: Extracting data for car ID: 1988927
2026-03-27 16:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e484b92-0308-50df-9002-b480df42c181 with identifier: 1988927
2026-03-27 16:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e484b92-0308-50df-9002-b480df42c181 with scrape type 1
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/1.jpg not downloaded yet
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/2.jpg not downloaded yet
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b23490>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/6.jpg saved to cache
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba0650>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/7.jpg saved to cache
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68517710>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/7.jpg saved to cache
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba3650>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/8.jpg saved to cache
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcb150>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/4.jpg saved to cache
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d46a10>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/5.jpg saved to cache
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acf010>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/3.jpg saved to cache
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/3.jpg not downloaded yet
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff4ed0>
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl4%252Feebe5723c5cb4757a371c43c8af8a0b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/3.jpg saved to cache
2026-03-27 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92894306-eabc-56a1-afdc-298c40030e71
2026-03-27 16:33:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92894306-eabc-56a1-afdc-298c40030e71, skipping ID generation
2026-03-27 16:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92894306-eabc-56a1-afdc-298c40030e71 with scrape type 1
2026-03-27 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92894306-eabc-56a1-afdc-298c40030e71 sending to next pipeline
2026-03-27 16:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 92894306-eabc-56a1-afdc-298c40030e71, identifier: 1988923
2026-03-27 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/4.jpg not downloaded yet
2026-03-27 16:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 92894306-eabc-56a1-afdc-298c40030e71 with identifier: 1988923
2026-03-27 16:33:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 92894306-eabc-56a1-afdc-298c40030e71 with identifier: 1988923
2026-03-27 16:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 92894306-eabc-56a1-afdc-298c40030e71 with identifier: 1988923 to the API
2026-03-27 16:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '92894306-eabc-56a1-afdc-298c40030e71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 4WD Vignale Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 52522,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571273,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92894306-eabc-56a1-afdc-298c40030e71/92894306-eabc-56a1-afdc-298c40030e71_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl4/eebe5723c5cb4757a371c43c8af8a0b9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 4WD Vignale Auto Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988923%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [ayvens.it] INFO: Saving data for 1988923: {'created_time': 1774629235.367569, 'last_price_update_time': 1774629235.367581, 'auction_closing_time': 1774944000.0}
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988923') HTTP/1.1" 204 0
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/5.jpg not downloaded yet
2026-03-27 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/6.jpg not downloaded yet
2026-03-27 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/7.jpg not downloaded yet
2026-03-27 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/8.jpg not downloaded yet
2026-03-27 16:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/9.jpg not downloaded yet
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/10.jpg not downloaded yet
2026-03-27 16:33:55 [ayvens.it] INFO: Found listing with ID: 1988928
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988928%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [ayvens.it] INFO: Scrape type for 1988928: 1
2026-03-27 16:33:55 [ayvens.it] INFO: Extracting data for car ID: 1988928
2026-03-27 16:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50ecbe9d-4888-5140-beae-b470a63cd3cc with identifier: 1988928
2026-03-27 16:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ecbe9d-4888-5140-beae-b470a63cd3cc with scrape type 1
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/1.jpg not downloaded yet
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/2.jpg not downloaded yet
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68abe2d0>
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/7.jpg saved to cache
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccc490>
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/3.jpg saved to cache
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69070190>
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/2.jpg saved to cache
2026-03-27 16:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0d510>
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/6.jpg saved to cache
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/3.jpg not downloaded yet
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835fcd0>
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/5.jpg saved to cache
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68522450>
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/2.jpg saved to cache
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925cad0>
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/4.jpg saved to cache
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923e6d0>
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/1.jpg saved to cache
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/4.jpg not downloaded yet
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/5.jpg not downloaded yet
2026-03-27 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/6.jpg not downloaded yet
2026-03-27 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/7.jpg not downloaded yet
2026-03-27 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/8.jpg not downloaded yet
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/9.jpg not downloaded yet
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/10.jpg not downloaded yet
2026-03-27 16:33:56 [ayvens.it] INFO: Found listing with ID: 1988929
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988929%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [ayvens.it] INFO: Scrape type for 1988929: 1
2026-03-27 16:33:56 [ayvens.it] INFO: Extracting data for car ID: 1988929
2026-03-27 16:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c42cb4-9bec-539c-bce9-e64e706a7783 with identifier: 1988929
2026-03-27 16:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c42cb4-9bec-539c-bce9-e64e706a7783 with scrape type 1
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/1.jpg not downloaded yet
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/2.jpg not downloaded yet
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8d150>
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/5.jpg saved to cache
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69356690>
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/7.jpg saved to cache
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c5910>
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/6.jpg saved to cache
2026-03-27 16:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ec410>
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/10.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18150>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/4.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3d3d0>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/3.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc9150>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/1.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c201d0>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/9.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/3.jpg not downloaded yet
2026-03-27 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/4.jpg not downloaded yet
2026-03-27 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/5.jpg not downloaded yet
2026-03-27 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/6.jpg not downloaded yet
2026-03-27 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/7.jpg not downloaded yet
2026-03-27 16:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69339f90>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/2.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/8.jpg not downloaded yet
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/9.jpg not downloaded yet
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b80750>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/4.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b30490>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/6.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/10.jpg not downloaded yet
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692dd750>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/7.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0c790>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/5.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:57 [ayvens.it] INFO: Found listing with ID: 1988930
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988930%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [ayvens.it] INFO: Scrape type for 1988930: 1
2026-03-27 16:33:57 [ayvens.it] INFO: Extracting data for car ID: 1988930
2026-03-27 16:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0816d2cd-4f01-587e-b3e6-1cee0794d353 with identifier: 1988930
2026-03-27 16:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0816d2cd-4f01-587e-b3e6-1cee0794d353 with scrape type 1
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/1.jpg not downloaded yet
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1c510>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/10.jpg saved to cache
2026-03-27 16:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68954390>
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/1.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692def10>
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/3.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/2.jpg not downloaded yet
2026-03-27 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/3.jpg not downloaded yet
2026-03-27 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/4.jpg not downloaded yet
2026-03-27 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/5.jpg not downloaded yet
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/6.jpg not downloaded yet
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/7.jpg not downloaded yet
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aea790>
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/10.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/8.jpg not downloaded yet
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc16d0>
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/4.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af7e10>
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/7.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/9.jpg not downloaded yet
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/10.jpg not downloaded yet
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b8bc50>
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/5.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69091910>
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/6.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fad0d0>
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/9.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692de350>
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/2.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68481e90>
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/1.jpg saved to cache
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:58 [ayvens.it] INFO: Found listing with ID: 1988931
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988931%27 HTTP/1.1" 200 None
2026-03-27 16:33:58 [ayvens.it] INFO: Scrape type for 1988931: 1
2026-03-27 16:33:58 [ayvens.it] INFO: Extracting data for car ID: 1988931
2026-03-27 16:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcdb9480-cd9a-5a16-b158-94ab81126f72 with identifier: 1988931
2026-03-27 16:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcdb9480-cd9a-5a16-b158-94ab81126f72 with scrape type 1
2026-03-27 16:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/1.jpg not downloaded yet
2026-03-27 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/2.jpg not downloaded yet
2026-03-27 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/3.jpg not downloaded yet
2026-03-27 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/4.jpg not downloaded yet
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/5.jpg not downloaded yet
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/6.jpg not downloaded yet
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690195d0>
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/10.jpg saved to cache
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69018c90>
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/9.jpg saved to cache
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/7.jpg not downloaded yet
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad10a10>
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/3.jpg saved to cache
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f9250>
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/6.jpg saved to cache
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec0fd0>
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/1.jpg saved to cache
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684fb750>
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/2.jpg saved to cache
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914db90>
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/4.jpg saved to cache
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/8.jpg not downloaded yet
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/9.jpg not downloaded yet
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c54ad0>
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/5.jpg saved to cache
2026-03-27 16:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/10.jpg not downloaded yet
2026-03-27 16:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [ayvens.it] INFO: Found listing with ID: 1988932
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988932%27 HTTP/1.1" 200 None
2026-03-27 16:34:00 [ayvens.it] INFO: Scrape type for 1988932: 1
2026-03-27 16:34:00 [ayvens.it] INFO: Extracting data for car ID: 1988932
2026-03-27 16:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with identifier: 1988932
2026-03-27 16:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with scrape type 1
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/1.jpg not downloaded yet
2026-03-27 16:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/2.jpg not downloaded yet
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/3.jpg not downloaded yet
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e4050>
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/3.jpg saved to cache
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6a9ff890>
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/4.jpg saved to cache
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/4.jpg not downloaded yet
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936b850>
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/2.jpg saved to cache
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/5.jpg not downloaded yet
2026-03-27 16:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/6.jpg not downloaded yet
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2350>
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/9.jpg saved to cache
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d02e50>
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/8.jpg saved to cache
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef4150>
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/10.jpg saved to cache
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccc610>
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252F626fd18a242d4a818ac0d172482d6e5b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/7.jpg saved to cache
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49c42cb4-9bec-539c-bce9-e64e706a7783
2026-03-27 16:34:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49c42cb4-9bec-539c-bce9-e64e706a7783, skipping ID generation
2026-03-27 16:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c42cb4-9bec-539c-bce9-e64e706a7783 with scrape type 1
2026-03-27 16:34:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49c42cb4-9bec-539c-bce9-e64e706a7783 sending to next pipeline
2026-03-27 16:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 49c42cb4-9bec-539c-bce9-e64e706a7783, identifier: 1988929
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e698e8890>
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/1.jpg saved to cache
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 49c42cb4-9bec-539c-bce9-e64e706a7783 with identifier: 1988929
2026-03-27 16:34:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 49c42cb4-9bec-539c-bce9-e64e706a7783 with identifier: 1988929
2026-03-27 16:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 49c42cb4-9bec-539c-bce9-e64e706a7783 with identifier: 1988929 to the API
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MYTHOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '49c42cb4-9bec-539c-bce9-e64e706a7783',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 50 TFSI e Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 56056,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636575,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636575,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627395,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c42cb4-9bec-539c-bce9-e64e706a7783/49c42cb4-9bec-539c-bce9-e64e706a7783_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/626fd18a242d4a818ac0d172482d6e5b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 50 TFSI e Business quattro S tronic Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988929%27 HTTP/1.1" 200 None
2026-03-27 16:34:01 [ayvens.it] INFO: Saving data for 1988929: {'created_time': 1774629241.497378, 'last_price_update_time': 1774629241.497394, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988929') HTTP/1.1" 204 0
2026-03-27 16:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/7.jpg not downloaded yet
2026-03-27 16:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/8.jpg not downloaded yet
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acd290>
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/10.jpg saved to cache
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853ec10>
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/7.jpg saved to cache
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/9.jpg not downloaded yet
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/10.jpg not downloaded yet
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d44a10>
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/7.jpg saved to cache
2026-03-27 16:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d8850>
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/8.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b70290>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/2.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c88d0>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/6.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d20690>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/1.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68faf350>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh4%252F936667f530804c8393a3b52b2d958f59%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/9.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [ayvens.it] INFO: Found listing with ID: 1988933
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988933%27 HTTP/1.1" 200 None
2026-03-27 16:34:02 [ayvens.it] INFO: Scrape type for 1988933: 1
2026-03-27 16:34:02 [ayvens.it] INFO: Extracting data for car ID: 1988933
2026-03-27 16:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b196d70f-4049-5494-acf9-d9ed5517c614 with identifier: 1988933
2026-03-27 16:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b196d70f-4049-5494-acf9-d9ed5517c614 with scrape type 1
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/1.jpg not downloaded yet
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/2.jpg not downloaded yet
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69338a90>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/8.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0c550>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/10.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925d9d0>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/6.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/3.jpg not downloaded yet
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/4.jpg not downloaded yet
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/5.jpg not downloaded yet
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69368c50>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/9.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/6.jpg not downloaded yet
2026-03-27 16:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/7.jpg not downloaded yet
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb1fd0>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/5.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928f6d0>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/3.jpg saved to cache
2026-03-27 16:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c57590>
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/1.jpg saved to cache
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c99bd0>
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Fc5d921f3f6784075ae99a1a7e91923de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/4.jpg saved to cache
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcdb9480-cd9a-5a16-b158-94ab81126f72
2026-03-27 16:34:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcdb9480-cd9a-5a16-b158-94ab81126f72, skipping ID generation
2026-03-27 16:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcdb9480-cd9a-5a16-b158-94ab81126f72 with scrape type 1
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcdb9480-cd9a-5a16-b158-94ab81126f72 sending to next pipeline
2026-03-27 16:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dcdb9480-cd9a-5a16-b158-94ab81126f72, identifier: 1988931
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/8.jpg not downloaded yet
2026-03-27 16:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dcdb9480-cd9a-5a16-b158-94ab81126f72 with identifier: 1988931
2026-03-27 16:34:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dcdb9480-cd9a-5a16-b158-94ab81126f72 with identifier: 1988931
2026-03-27 16:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dcdb9480-cd9a-5a16-b158-94ab81126f72 with identifier: 1988931 to the API
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'electric',
'id': 'dcdb9480-cd9a-5a16-b158-94ab81126f72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT (PC) T/P ELETTRICO 68KWH 184CV 350 L3H2 TREND F FP',
'odometer': 90852,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 84,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251104,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdb9480-cd9a-5a16-b158-94ab81126f72/dcdb9480-cd9a-5a16-b158-94ab81126f72_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/c5d921f3f6784075ae99a1a7e91923de/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT (PC) T/P ELETTRICO 68KWH 184CV 350 L3H2 TREND F '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988931%27 HTTP/1.1" 200 None
2026-03-27 16:34:03 [ayvens.it] INFO: Saving data for 1988931: {'created_time': 1774629243.651493, 'last_price_update_time': 1774629243.651504, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988931') HTTP/1.1" 204 0
2026-03-27 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/9.jpg not downloaded yet
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/10.jpg not downloaded yet
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c55d50>
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/5.jpg saved to cache
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0816d2cd-4f01-587e-b3e6-1cee0794d353, skipping ID generation
2026-03-27 16:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0816d2cd-4f01-587e-b3e6-1cee0794d353 with scrape type 1
2026-03-27 16:34:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0816d2cd-4f01-587e-b3e6-1cee0794d353 sending to next pipeline
2026-03-27 16:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0816d2cd-4f01-587e-b3e6-1cee0794d353, identifier: 1988930
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c11f10>
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/3.jpg saved to cache
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0816d2cd-4f01-587e-b3e6-1cee0794d353 with identifier: 1988930
2026-03-27 16:34:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0816d2cd-4f01-587e-b3e6-1cee0794d353 with identifier: 1988930
2026-03-27 16:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0816d2cd-4f01-587e-b3e6-1cee0794d353 with identifier: 1988930 to the API
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:04 [scrapy.core.scraper] DEBUG: Scraped from <404 https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MINERAL WHITE SOLIDO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '0816d2cd-4f01-587e-b3e6-1cee0794d353',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN NV250 1.5 dCi 95cv L1 Van Vettura Furgonata 4-door (Euro '
'6.2)',
'odometer': 93616,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 89,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 713269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484221,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423129,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365851,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0816d2cd-4f01-587e-b3e6-1cee0794d353/0816d2cd-4f01-587e-b3e6-1cee0794d353_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh4/936667f530804c8393a3b52b2d958f59/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN NV250 1.5 dCi 95cv L1 Van Vettura Furgonata 4-door '
'(Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988930%27 HTTP/1.1" 200 None
2026-03-27 16:34:04 [ayvens.it] INFO: Saving data for 1988930: {'created_time': 1774629244.403695, 'last_price_update_time': 1774629244.403708, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988930') HTTP/1.1" 204 0
2026-03-27 16:34:04 [ayvens.it] INFO: Found listing with ID: 1988934
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988934%27 HTTP/1.1" 200 None
2026-03-27 16:34:04 [ayvens.it] INFO: Scrape type for 1988934: 1
2026-03-27 16:34:04 [ayvens.it] INFO: Extracting data for car ID: 1988934
2026-03-27 16:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67084afc-39ba-50be-96b1-8609e8ab90d1 with identifier: 1988934
2026-03-27 16:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67084afc-39ba-50be-96b1-8609e8ab90d1 with scrape type 1
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/1.jpg not downloaded yet
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 0816d2cd-4f01-587e-b3e6-1cee0794d353 due to Ignoring non-200 response
2026-03-27 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/2.jpg not downloaded yet
2026-03-27 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923da50>
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/6.jpg saved to cache
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc2050>
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/4.jpg saved to cache
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c23dd0>
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/2.jpg saved to cache
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69046050>
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/9.jpg saved to cache
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/3.jpg not downloaded yet
2026-03-27 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/4.jpg not downloaded yet
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68611510>
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/7.jpg saved to cache
2026-03-27 16:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af7290>
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F57cfdcb31b6844f4af7b62e67b1580ce%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/8.jpg saved to cache
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50ecbe9d-4888-5140-beae-b470a63cd3cc
2026-03-27 16:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50ecbe9d-4888-5140-beae-b470a63cd3cc, skipping ID generation
2026-03-27 16:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ecbe9d-4888-5140-beae-b470a63cd3cc with scrape type 1
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50ecbe9d-4888-5140-beae-b470a63cd3cc sending to next pipeline
2026-03-27 16:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 50ecbe9d-4888-5140-beae-b470a63cd3cc, identifier: 1988928
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928d410>
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/10.jpg saved to cache
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 50ecbe9d-4888-5140-beae-b470a63cd3cc with identifier: 1988928
2026-03-27 16:34:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 50ecbe9d-4888-5140-beae-b470a63cd3cc with identifier: 1988928
2026-03-27 16:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 50ecbe9d-4888-5140-beae-b470a63cd3cc with identifier: 1988928 to the API
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Deep Black perla',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '50ecbe9d-4888-5140-beae-b470a63cd3cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 124066,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ecbe9d-4888-5140-beae-b470a63cd3cc/50ecbe9d-4888-5140-beae-b470a63cd3cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/57cfdcb31b6844f4af7b62e67b1580ce/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988928%27 HTTP/1.1" 200 None
2026-03-27 16:34:05 [ayvens.it] INFO: Saving data for 1988928: {'created_time': 1774629245.636445, 'last_price_update_time': 1774629245.636456, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988928') HTTP/1.1" 204 0
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/5.jpg not downloaded yet
2026-03-27 16:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/6.jpg not downloaded yet
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936b910>
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk6%252F0b8c887282104e308db3084b48f722e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/8.jpg saved to cache
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be
2026-03-27 16:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be, skipping ID generation
2026-03-27 16:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with scrape type 1
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be sending to next pipeline
2026-03-27 16:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be, identifier: 1988932
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b024d0>
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/2.jpg saved to cache
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ecbd0>
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fe2c4e49d472849d69a21c3ea2f186f65%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/8.jpg saved to cache
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e484b92-0308-50df-9002-b480df42c181
2026-03-27 16:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e484b92-0308-50df-9002-b480df42c181, skipping ID generation
2026-03-27 16:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e484b92-0308-50df-9002-b480df42c181 with scrape type 1
2026-03-27 16:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e484b92-0308-50df-9002-b480df42c181 sending to next pipeline
2026-03-27 16:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8e484b92-0308-50df-9002-b480df42c181, identifier: 1988927
2026-03-27 16:34:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 3 pages/min), scraped 76 items (at 29 items/min)
2026-03-27 16:34:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/7.jpg not downloaded yet
2026-03-27 16:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with identifier: 1988932
2026-03-27 16:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with identifier: 1988932
2026-03-27 16:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6b9d88c4-7758-54d7-adaa-0c95f4e9c6be with identifier: 1988932 to the API
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '6b9d88c4-7758-54d7-adaa-0c95f4e9c6be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP',
'odometer': 85813,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438008,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576760,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9d88c4-7758-54d7-adaa-0c95f4e9c6be/6b9d88c4-7758-54d7-adaa-0c95f4e9c6be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk6/0b8c887282104e308db3084b48f722e7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988932%27 HTTP/1.1" 200 None
2026-03-27 16:34:06 [ayvens.it] INFO: Saving data for 1988932: {'created_time': 1774629246.375203, 'last_price_update_time': 1774629246.375215, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988932') HTTP/1.1" 204 0
2026-03-27 16:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8e484b92-0308-50df-9002-b480df42c181 with identifier: 1988927
2026-03-27 16:34:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8e484b92-0308-50df-9002-b480df42c181 with identifier: 1988927
2026-03-27 16:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8e484b92-0308-50df-9002-b480df42c181 with identifier: 1988927 to the API
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NATURAL WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '8e484b92-0308-50df-9002-b480df42c181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C5 AIRCROSS (PC BLUEHDI 130 S&S C-SERIES EAT8',
'odometer': 48701,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471922,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e484b92-0308-50df-9002-b480df42c181/8e484b92-0308-50df-9002-b480df42c181_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/e2c4e49d472849d69a21c3ea2f186f65/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C5 AIRCROSS (PC BLUEHDI 130 S&S C-SERIES EAT8 -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988927%27 HTTP/1.1" 200 None
2026-03-27 16:34:06 [ayvens.it] INFO: Saving data for 1988927: {'created_time': 1774629246.678618, 'last_price_update_time': 1774629246.678628, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988927') HTTP/1.1" 204 0
2026-03-27 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/8.jpg not downloaded yet
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692805d0>
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/1.jpg saved to cache
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/9.jpg not downloaded yet
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/10.jpg not downloaded yet
2026-03-27 16:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835e090>
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/5.jpg saved to cache
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d02210>
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/9.jpg saved to cache
2026-03-27 16:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:07 [ayvens.it] INFO: Found listing with ID: 1988935
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988935%27 HTTP/1.1" 200 None
2026-03-27 16:34:07 [ayvens.it] INFO: Scrape type for 1988935: 1
2026-03-27 16:34:07 [ayvens.it] INFO: Extracting data for car ID: 1988935
2026-03-27 16:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15452c3d-ec87-5d70-abd9-1543b0ab346e with identifier: 1988935
2026-03-27 16:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15452c3d-ec87-5d70-abd9-1543b0ab346e with scrape type 1
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/1.jpg not downloaded yet
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/2.jpg not downloaded yet
2026-03-27 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/3.jpg not downloaded yet
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69324210>
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/4.jpg saved to cache
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690186d0>
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/3.jpg saved to cache
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fec150>
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fcd4b0e687d52424aaaa332eeb9026f7e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/8.jpg saved to cache
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7
2026-03-27 16:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67029932-5c3c-52b8-b2a5-bff35f6f92d7, skipping ID generation
2026-03-27 16:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with scrape type 1
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67029932-5c3c-52b8-b2a5-bff35f6f92d7 sending to next pipeline
2026-03-27 16:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 67029932-5c3c-52b8-b2a5-bff35f6f92d7, identifier: 1988926
2026-03-27 16:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with identifier: 1988926
2026-03-27 16:34:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with identifier: 1988926
2026-03-27 16:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 67029932-5c3c-52b8-b2a5-bff35f6f92d7 with identifier: 1988926 to the API
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '67029932-5c3c-52b8-b2a5-bff35f6f92d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 ECOBOOST HYBRID 125CV ST-LINE AUTO FP',
'odometer': 185457,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436546,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438943,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67029932-5c3c-52b8-b2a5-bff35f6f92d7/67029932-5c3c-52b8-b2a5-bff35f6f92d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/cd4b0e687d52424aaaa332eeb9026f7e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 ECOBOOST HYBRID 125CV ST-LINE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988926%27 HTTP/1.1" 200 None
2026-03-27 16:34:07 [ayvens.it] INFO: Saving data for 1988926: {'created_time': 1774629247.736679, 'last_price_update_time': 1774629247.736689, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988926') HTTP/1.1" 204 0
2026-03-27 16:34:07 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:07 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/4.jpg not downloaded yet
2026-03-27 16:34:07 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/5.jpg not downloaded yet
2026-03-27 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69018190>
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/7.jpg saved to cache
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835e850>
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/8.jpg saved to cache
2026-03-27 16:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2dd0>
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/6.jpg saved to cache
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/6.jpg not downloaded yet
2026-03-27 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:08 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/7.jpg not downloaded yet
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b234d50>
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/9.jpg saved to cache
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b01750>
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fc6b73e2945874ede8740f4653a560d00%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/8.jpg saved to cache
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3
2026-03-27 16:34:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3, skipping ID generation
2026-03-27 16:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with scrape type 1
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 sending to next pipeline
2026-03-27 16:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3, identifier: 1988925
2026-03-27 16:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with identifier: 1988925
2026-03-27 16:34:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with identifier: 1988925
2026-03-27 16:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3 with identifier: 1988925 to the API
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO RUBINO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN',
'odometer': 159547,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545950,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3/74b9dd4c-1b53-5593-9ffd-d77d29d6b5c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522773,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/c6b73e2945874ede8740f4653a560d00/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988925%27 HTTP/1.1" 200 None
2026-03-27 16:34:08 [ayvens.it] INFO: Saving data for 1988925: {'created_time': 1774629248.663023, 'last_price_update_time': 1774629248.663036, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988925') HTTP/1.1" 204 0
2026-03-27 16:34:08 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:08 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/8.jpg not downloaded yet
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/9.jpg not downloaded yet
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bec310>
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/1.jpg saved to cache
2026-03-27 16:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d44f50>
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Ffbafcc8acc2243a1861c7f5bcd4d0e36%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/10.jpg saved to cache
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b196d70f-4049-5494-acf9-d9ed5517c614
2026-03-27 16:34:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b196d70f-4049-5494-acf9-d9ed5517c614, skipping ID generation
2026-03-27 16:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b196d70f-4049-5494-acf9-d9ed5517c614 with scrape type 1
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b196d70f-4049-5494-acf9-d9ed5517c614 sending to next pipeline
2026-03-27 16:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b196d70f-4049-5494-acf9-d9ed5517c614, identifier: 1988933
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e4c10>
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/3.jpg saved to cache
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/10.jpg not downloaded yet
2026-03-27 16:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b196d70f-4049-5494-acf9-d9ed5517c614 with identifier: 1988933
2026-03-27 16:34:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b196d70f-4049-5494-acf9-d9ed5517c614 with identifier: 1988933
2026-03-27 16:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b196d70f-4049-5494-acf9-d9ed5517c614 with identifier: 1988933 to the API
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'b196d70f-4049-5494-acf9-d9ed5517c614',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK',
'odometer': 127520,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b196d70f-4049-5494-acf9-d9ed5517c614/b196d70f-4049-5494-acf9-d9ed5517c614_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/fbafcc8acc2243a1861c7f5bcd4d0e36/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988933%27 HTTP/1.1" 200 None
2026-03-27 16:34:09 [ayvens.it] INFO: Saving data for 1988933: {'created_time': 1774629249.445202, 'last_price_update_time': 1774629249.445212, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988933') HTTP/1.1" 204 0
2026-03-27 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:09 [ayvens.it] INFO: Found listing with ID: 1988936
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988936%27 HTTP/1.1" 200 None
2026-03-27 16:34:09 [ayvens.it] INFO: Scrape type for 1988936: 1
2026-03-27 16:34:09 [ayvens.it] INFO: Extracting data for car ID: 1988936
2026-03-27 16:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 483d98d2-0a14-51c4-8cf4-095412922344 with identifier: 1988936
2026-03-27 16:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483d98d2-0a14-51c4-8cf4-095412922344 with scrape type 1
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/1.jpg not downloaded yet
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 67084afc-39ba-50be-96b1-8609e8ab90d1 due to Ignoring non-200 response
2026-03-27 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/2.jpg not downloaded yet
2026-03-27 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/3.jpg not downloaded yet
2026-03-27 16:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f4390>
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/3.jpg saved to cache
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/4.jpg not downloaded yet
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb7f90>
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/8.jpg saved to cache
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0c990>
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F6828afb05815421b94d38ba8b0cca2f6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/6.jpg saved to cache
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67084afc-39ba-50be-96b1-8609e8ab90d1
2026-03-27 16:34:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67084afc-39ba-50be-96b1-8609e8ab90d1, skipping ID generation
2026-03-27 16:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67084afc-39ba-50be-96b1-8609e8ab90d1 with scrape type 1
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67084afc-39ba-50be-96b1-8609e8ab90d1 sending to next pipeline
2026-03-27 16:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 67084afc-39ba-50be-96b1-8609e8ab90d1, identifier: 1988934
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/5.jpg not downloaded yet
2026-03-27 16:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 67084afc-39ba-50be-96b1-8609e8ab90d1 with identifier: 1988934
2026-03-27 16:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 67084afc-39ba-50be-96b1-8609e8ab90d1 with identifier: 1988934
2026-03-27 16:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 67084afc-39ba-50be-96b1-8609e8ab90d1 with identifier: 1988934 to the API
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Agate Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '67084afc-39ba-50be-96b1-8609e8ab90d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.0 EcoBlue 120CV AWD ST-Line Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 204521,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67084afc-39ba-50be-96b1-8609e8ab90d1/67084afc-39ba-50be-96b1-8609e8ab90d1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630626,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/6828afb05815421b94d38ba8b0cca2f6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.0 EcoBlue 120CV AWD ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988934%27 HTTP/1.1" 200 None
2026-03-27 16:34:10 [ayvens.it] INFO: Saving data for 1988934: {'created_time': 1774629250.316416, 'last_price_update_time': 1774629250.316426, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988934') HTTP/1.1" 204 0
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/6.jpg not downloaded yet
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69071e90>
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/10.jpg saved to cache
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68addc10>
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/2.jpg saved to cache
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba9410>
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/9.jpg saved to cache
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c10c50>
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/1.jpg saved to cache
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853fc50>
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F6398e8b7d21d4f03ab1eb8d91152ff40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/8.jpg saved to cache
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144
2026-03-27 16:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144, skipping ID generation
2026-03-27 16:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with scrape type 1
2026-03-27 16:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 sending to next pipeline
2026-03-27 16:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144, identifier: 1988924
2026-03-27 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with identifier: 1988924
2026-03-27 16:34:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with identifier: 1988924
2026-03-27 16:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144 with identifier: 1988924 to the API
2026-03-27 16:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV Tit. Des. Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 76166,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 111,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657296,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663753,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531866,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144/799a1ab9-9082-5ba3-bb6b-5bf6d4bb3144_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 466584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/6398e8b7d21d4f03ab1eb8d91152ff40/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV Tit. Des. Auto Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988924%27 HTTP/1.1" 200 None
2026-03-27 16:34:11 [ayvens.it] INFO: Saving data for 1988924: {'created_time': 1774629251.152021, 'last_price_update_time': 1774629251.15203, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988924') HTTP/1.1" 204 0
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/7.jpg not downloaded yet
2026-03-27 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/8.jpg not downloaded yet
2026-03-27 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d95d0>
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/4.jpg saved to cache
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc2150>
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/6.jpg saved to cache
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/9.jpg not downloaded yet
2026-03-27 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/10.jpg not downloaded yet
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69141610>
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/10.jpg saved to cache
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc1110>
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/7.jpg saved to cache
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69140910>
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/5.jpg saved to cache
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:11 [ayvens.it] INFO: Found listing with ID: 1988937
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988937%27 HTTP/1.1" 200 None
2026-03-27 16:34:11 [ayvens.it] INFO: Scrape type for 1988937: 1
2026-03-27 16:34:11 [ayvens.it] INFO: Extracting data for car ID: 1988937
2026-03-27 16:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with identifier: 1988937
2026-03-27 16:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with scrape type 1
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/1.jpg not downloaded yet
2026-03-27 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/2.jpg not downloaded yet
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b49a50>
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/8.jpg saved to cache
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69300c10>
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F7e475b7b200341099a355c1b5cb361f1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/9.jpg saved to cache
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 672d93f8-e491-5d9a-a1c3-e6257488a356
2026-03-27 16:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 672d93f8-e491-5d9a-a1c3-e6257488a356, skipping ID generation
2026-03-27 16:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672d93f8-e491-5d9a-a1c3-e6257488a356 with scrape type 1
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 672d93f8-e491-5d9a-a1c3-e6257488a356 sending to next pipeline
2026-03-27 16:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 672d93f8-e491-5d9a-a1c3-e6257488a356, identifier: 1988922
2026-03-27 16:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/3.jpg not downloaded yet
2026-03-27 16:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 672d93f8-e491-5d9a-a1c3-e6257488a356 with identifier: 1988922
2026-03-27 16:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 672d93f8-e491-5d9a-a1c3-e6257488a356 with identifier: 1988922
2026-03-27 16:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 672d93f8-e491-5d9a-a1c3-e6257488a356 with identifier: 1988922 to the API
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Black Sapphire',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '672d93f8-e491-5d9a-a1c3-e6257488a356',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIE 1 116d Business Advantage Hatchback 5-door (Euro 6D)',
'odometer': 175982,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 610310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568821,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554572,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607764,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579760,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672d93f8-e491-5d9a-a1c3-e6257488a356/672d93f8-e491-5d9a-a1c3-e6257488a356_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550194,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/7e475b7b200341099a355c1b5cb361f1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIE 1 116d Business Advantage Hatchback 5-door (Euro 6D) '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988922%27 HTTP/1.1" 200 None
2026-03-27 16:34:12 [ayvens.it] INFO: Saving data for 1988922: {'created_time': 1774629252.354564, 'last_price_update_time': 1774629252.354575, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988922') HTTP/1.1" 204 0
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/4.jpg not downloaded yet
2026-03-27 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/5.jpg not downloaded yet
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f0c50>
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd6%252F2e4071a8af604f36a3f8fccb6dfb6e1a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/7.jpg saved to cache
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e
2026-03-27 16:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e, skipping ID generation
2026-03-27 16:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e with scrape type 1
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e sending to next pipeline
2026-03-27 16:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e, identifier: 1988921
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69302a50>
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/9.jpg saved to cache
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc3ed0>
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/10.jpg saved to cache
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853f950>
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge4%252F7fd4552fc18343df8fe03a1d581d369e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/8.jpg saved to cache
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15452c3d-ec87-5d70-abd9-1543b0ab346e
2026-03-27 16:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15452c3d-ec87-5d70-abd9-1543b0ab346e, skipping ID generation
2026-03-27 16:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15452c3d-ec87-5d70-abd9-1543b0ab346e with scrape type 1
2026-03-27 16:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15452c3d-ec87-5d70-abd9-1543b0ab346e sending to next pipeline
2026-03-27 16:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 15452c3d-ec87-5d70-abd9-1543b0ab346e, identifier: 1988935
2026-03-27 16:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e with identifier: 1988921
2026-03-27 16:34:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e with identifier: 1988921
2026-03-27 16:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e with identifier: 1988921 to the API
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero notte pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.9L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES-BENZ GLB GLB 200 d Automatic Executive Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 129855,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 796199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 796199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 842237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 837713,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 833055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687866,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e/a35f5c17-dab1-5daa-9d6a-6ef67cc62a4e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd6/2e4071a8af604f36a3f8fccb6dfb6e1a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES-BENZ GLB GLB 200 d Automatic Executive Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988921%27 HTTP/1.1" 200 None
2026-03-27 16:34:13 [ayvens.it] INFO: Saving data for 1988921: {'created_time': 1774629253.432447, 'last_price_update_time': 1774629253.432456, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988921') HTTP/1.1" 204 0
2026-03-27 16:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 15452c3d-ec87-5d70-abd9-1543b0ab346e with identifier: 1988935
2026-03-27 16:34:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 15452c3d-ec87-5d70-abd9-1543b0ab346e with identifier: 1988935
2026-03-27 16:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 15452c3d-ec87-5d70-abd9-1543b0ab346e with identifier: 1988935 to the API
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SEOUL PEARL SILVER METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '15452c3d-ec87-5d70-abd9-1543b0ab346e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 1.5 P300E PHEV R-DYNAMIC SE AWD AUTO '
'(PC) FP',
'odometer': 112263,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261233,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15452c3d-ec87-5d70-abd9-1543b0ab346e/15452c3d-ec87-5d70-abd9-1543b0ab346e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge4/7fd4552fc18343df8fe03a1d581d369e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 1.5 P300E PHEV R-DYNAMIC SE '
'AWD AUTO (PC) FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988935%27 HTTP/1.1" 200 None
2026-03-27 16:34:13 [ayvens.it] INFO: Saving data for 1988935: {'created_time': 1774629253.736118, 'last_price_update_time': 1774629253.736129, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988935') HTTP/1.1" 204 0
2026-03-27 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/6.jpg not downloaded yet
2026-03-27 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/7.jpg not downloaded yet
2026-03-27 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853cbd0>
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/9.jpg saved to cache
2026-03-27 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69369950>
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/10.jpg saved to cache
2026-03-27 16:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69517d90>
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/1.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/8.jpg not downloaded yet
2026-03-27 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/9.jpg not downloaded yet
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b3ef10>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/5.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1cf90>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/6.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d01410>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/2.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad12250>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/8.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcc690>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/7.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/10.jpg not downloaded yet
2026-03-27 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:14 [ayvens.it] INFO: Found listing with ID: 1988938
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988938%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [ayvens.it] INFO: Scrape type for 1988938: 1
2026-03-27 16:34:14 [ayvens.it] INFO: Extracting data for car ID: 1988938
2026-03-27 16:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with identifier: 1988938
2026-03-27 16:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with scrape type 1
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/1.jpg not downloaded yet
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af51d0>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/3.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/2.jpg not downloaded yet
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/3.jpg not downloaded yet
2026-03-27 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/4.jpg not downloaded yet
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e4050>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/8.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693005d0>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/4.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690440d0>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/9.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/5.jpg not downloaded yet
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/6.jpg not downloaded yet
2026-03-27 16:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba8410>
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F865239a110c948f6a525d6abeb73a222%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/10.jpg saved to cache
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 483d98d2-0a14-51c4-8cf4-095412922344
2026-03-27 16:34:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 483d98d2-0a14-51c4-8cf4-095412922344, skipping ID generation
2026-03-27 16:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483d98d2-0a14-51c4-8cf4-095412922344 with scrape type 1
2026-03-27 16:34:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 483d98d2-0a14-51c4-8cf4-095412922344 sending to next pipeline
2026-03-27 16:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 483d98d2-0a14-51c4-8cf4-095412922344, identifier: 1988936
2026-03-27 16:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7e910>
2026-03-27 16:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F1c90f172f3664b45b974f0e2c5ab6690%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/1.jpg saved to cache
2026-03-27 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c998a9d-60a0-500d-97b6-eda95605138f
2026-03-27 16:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c998a9d-60a0-500d-97b6-eda95605138f, skipping ID generation
2026-03-27 16:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c998a9d-60a0-500d-97b6-eda95605138f with scrape type 1
2026-03-27 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c998a9d-60a0-500d-97b6-eda95605138f sending to next pipeline
2026-03-27 16:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9c998a9d-60a0-500d-97b6-eda95605138f, identifier: 1988920
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/7.jpg not downloaded yet
2026-03-27 16:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 483d98d2-0a14-51c4-8cf4-095412922344 with identifier: 1988936
2026-03-27 16:34:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 483d98d2-0a14-51c4-8cf4-095412922344 with identifier: 1988936
2026-03-27 16:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 483d98d2-0a14-51c4-8cf4-095412922344 with identifier: 1988936 to the API
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO VULCANO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '483d98d2-0a14-51c4-8cf4-095412922344',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV SPRINT AT8 Q4 FP',
'odometer': 131150,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563534,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331848,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483d98d2-0a14-51c4-8cf4-095412922344/483d98d2-0a14-51c4-8cf4-095412922344_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494241,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/865239a110c948f6a525d6abeb73a222/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV SPRINT AT8 Q4 '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988936%27 HTTP/1.1" 200 None
2026-03-27 16:34:15 [ayvens.it] INFO: Saving data for 1988936: {'created_time': 1774629255.576739, 'last_price_update_time': 1774629255.57675, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988936') HTTP/1.1" 204 0
2026-03-27 16:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9c998a9d-60a0-500d-97b6-eda95605138f with identifier: 1988920
2026-03-27 16:34:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9c998a9d-60a0-500d-97b6-eda95605138f with identifier: 1988920
2026-03-27 16:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9c998a9d-60a0-500d-97b6-eda95605138f with identifier: 1988920 to the API
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Super White pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '9c998a9d-60a0-500d-97b6-eda95605138f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA TS 1.8 Hybrid Active SW 5-door (Euro 6.2)',
'odometer': 80385,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575252,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575252,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546725,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575005,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595776,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506385,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c998a9d-60a0-500d-97b6-eda95605138f/9c998a9d-60a0-500d-97b6-eda95605138f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/1c90f172f3664b45b974f0e2c5ab6690/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA TS 1.8 Hybrid Active SW 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988920%27 HTTP/1.1" 200 None
2026-03-27 16:34:16 [ayvens.it] INFO: Saving data for 1988920: {'created_time': 1774629256.02374, 'last_price_update_time': 1774629256.02375, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988920') HTTP/1.1" 204 0
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/8.jpg not downloaded yet
2026-03-27 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/9.jpg not downloaded yet
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b3fa90>
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/10.jpg saved to cache
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c57ad0>
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/2.jpg saved to cache
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/10.jpg not downloaded yet
2026-03-27 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:16 [ayvens.it] INFO: Found listing with ID: 1988939
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988939%27 HTTP/1.1" 200 None
2026-03-27 16:34:16 [ayvens.it] INFO: Scrape type for 1988939: 1
2026-03-27 16:34:16 [ayvens.it] INFO: Extracting data for car ID: 1988939
2026-03-27 16:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e971de7b-28e5-5f28-8084-c0a8925b244d with identifier: 1988939
2026-03-27 16:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e971de7b-28e5-5f28-8084-c0a8925b244d with scrape type 1
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/1.jpg not downloaded yet
2026-03-27 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69141490>
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/3.jpg saved to cache
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/2.jpg not downloaded yet
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/3.jpg not downloaded yet
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/4.jpg not downloaded yet
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c8450>
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F5545c7898cbb45f789c7ed22871b1952%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/9.jpg saved to cache
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76f693b8-1adf-5742-bc0b-f7952cdae442
2026-03-27 16:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76f693b8-1adf-5742-bc0b-f7952cdae442, skipping ID generation
2026-03-27 16:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f693b8-1adf-5742-bc0b-f7952cdae442 with scrape type 1
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76f693b8-1adf-5742-bc0b-f7952cdae442 sending to next pipeline
2026-03-27 16:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 76f693b8-1adf-5742-bc0b-f7952cdae442, identifier: 1988919
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b6790>
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/4.jpg saved to cache
2026-03-27 16:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68612c50>
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/7.jpg saved to cache
2026-03-27 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f99a10>
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/1.jpg saved to cache
2026-03-27 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c56710>
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/5.jpg saved to cache
2026-03-27 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922d510>
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge0%252Fce36de50b00f450fb4fa3e1c31017797%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/7.jpg saved to cache
2026-03-27 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e
2026-03-27 16:34:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82c49a34-20bd-5aee-b2fa-e77d50dfa71e, skipping ID generation
2026-03-27 16:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e with scrape type 1
2026-03-27 16:34:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82c49a34-20bd-5aee-b2fa-e77d50dfa71e sending to next pipeline
2026-03-27 16:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 82c49a34-20bd-5aee-b2fa-e77d50dfa71e, identifier: 1988918
2026-03-27 16:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 76f693b8-1adf-5742-bc0b-f7952cdae442 with identifier: 1988919
2026-03-27 16:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 76f693b8-1adf-5742-bc0b-f7952cdae442 with identifier: 1988919
2026-03-27 16:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 76f693b8-1adf-5742-bc0b-f7952cdae442 with identifier: 1988919 to the API
2026-03-27 16:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO FROZEN PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '76f693b8-1adf-5742-bc0b-f7952cdae442',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC) FP',
'odometer': 197343,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 99,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 797793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 797793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 746276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 610332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 653148,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f693b8-1adf-5742-bc0b-f7952cdae442/76f693b8-1adf-5742-bc0b-f7952cdae442_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 713793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/5545c7898cbb45f789c7ed22871b1952/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC) FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988919%27 HTTP/1.1" 200 None
2026-03-27 16:34:18 [ayvens.it] INFO: Saving data for 1988919: {'created_time': 1774629258.436134, 'last_price_update_time': 1774629258.436144, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988919') HTTP/1.1" 204 0
2026-03-27 16:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 82c49a34-20bd-5aee-b2fa-e77d50dfa71e with identifier: 1988918
2026-03-27 16:34:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 82c49a34-20bd-5aee-b2fa-e77d50dfa71e with identifier: 1988918
2026-03-27 16:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 82c49a34-20bd-5aee-b2fa-e77d50dfa71e with identifier: 1988918 to the API
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MINERAL WHITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '82c49a34-20bd-5aee-b2fa-e77d50dfa71e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X3 xDrive 20d MH48V Business Advantage Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 138647,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506502,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535691,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439398,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c49a34-20bd-5aee-b2fa-e77d50dfa71e/82c49a34-20bd-5aee-b2fa-e77d50dfa71e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge0/ce36de50b00f450fb4fa3e1c31017797/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X3 xDrive 20d MH48V Business Advantage Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988918%27 HTTP/1.1" 200 None
2026-03-27 16:34:18 [ayvens.it] INFO: Saving data for 1988918: {'created_time': 1774629258.805944, 'last_price_update_time': 1774629258.805957, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988918') HTTP/1.1" 204 0
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/5.jpg not downloaded yet
2026-03-27 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb2f10>
2026-03-27 16:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/6.jpg saved to cache
2026-03-27 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/6.jpg not downloaded yet
2026-03-27 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/7.jpg not downloaded yet
2026-03-27 16:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/8.jpg not downloaded yet
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691cbbd0>
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/8.jpg saved to cache
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/9.jpg not downloaded yet
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/10.jpg not downloaded yet
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b88e10>
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/10.jpg saved to cache
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934e510>
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/10.jpg saved to cache
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1fed0>
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F2f0d8f12f5a64658a3843a9c377cc3b3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/9.jpg saved to cache
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0
2026-03-27 16:34:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0, skipping ID generation
2026-03-27 16:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with scrape type 1
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 sending to next pipeline
2026-03-27 16:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0, identifier: 1988937
2026-03-27 16:34:19 [ayvens.it] INFO: Found listing with ID: 1988940
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988940%27 HTTP/1.1" 200 None
2026-03-27 16:34:19 [ayvens.it] INFO: Scrape type for 1988940: 1
2026-03-27 16:34:19 [ayvens.it] INFO: Extracting data for car ID: 1988940
2026-03-27 16:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82fe07fb-7e5b-595c-b720-1f7b8744488f with identifier: 1988940
2026-03-27 16:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82fe07fb-7e5b-595c-b720-1f7b8744488f with scrape type 1
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/1.jpg not downloaded yet
2026-03-27 16:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with identifier: 1988937
2026-03-27 16:34:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with identifier: 1988937
2026-03-27 16:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9b2ea2df-f838-5481-a106-6d9ac9d2c5e0 with identifier: 1988937 to the API
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU ANODIZZATO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '9b2ea2df-f838-5481-a106-6d9ac9d2c5e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO 2.2 TD 210 CV TI AT8 Q4 FP',
'odometer': 142116,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 845586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 804663,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 892696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2ea2df-f838-5481-a106-6d9ac9d2c5e0/9b2ea2df-f838-5481-a106-6d9ac9d2c5e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569789,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/2f0d8f12f5a64658a3843a9c377cc3b3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO 2.2 TD 210 CV TI AT8 Q4 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988937%27 HTTP/1.1" 200 None
2026-03-27 16:34:19 [ayvens.it] INFO: Saving data for 1988937: {'created_time': 1774629259.892527, 'last_price_update_time': 1774629259.892537, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988937') HTTP/1.1" 204 0
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/2.jpg not downloaded yet
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/3.jpg not downloaded yet
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934fc50>
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/5.jpg saved to cache
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad13610>
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/1.jpg saved to cache
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c9bb90>
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/4.jpg saved to cache
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694daa90>
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/3.jpg saved to cache
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/4.jpg not downloaded yet
2026-03-27 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/5.jpg not downloaded yet
2026-03-27 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/6.jpg not downloaded yet
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/7.jpg not downloaded yet
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/8.jpg not downloaded yet
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/9.jpg not downloaded yet
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef4f90>
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/9.jpg saved to cache
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691caa90>
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/8.jpg saved to cache
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/10.jpg not downloaded yet
2026-03-27 16:34:20 [ayvens.it] INFO: Found listing with ID: 1988941
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988941%27 HTTP/1.1" 200 None
2026-03-27 16:34:20 [ayvens.it] INFO: Scrape type for 1988941: 1
2026-03-27 16:34:20 [ayvens.it] INFO: Extracting data for car ID: 1988941
2026-03-27 16:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a753d9-cf3f-5b16-8913-6b05b9684e90 with identifier: 1988941
2026-03-27 16:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a753d9-cf3f-5b16-8913-6b05b9684e90 with scrape type 1
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/1.jpg not downloaded yet
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fed150>
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/7.jpg saved to cache
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc30d0>
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/6.jpg saved to cache
2026-03-27 16:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853c290>
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/5.jpg saved to cache
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69093610>
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/4.jpg saved to cache
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b55b50>
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/2.jpg saved to cache
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc7f50>
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/3.jpg saved to cache
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/2.jpg not downloaded yet
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/3.jpg not downloaded yet
2026-03-27 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/4.jpg not downloaded yet
2026-03-27 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/5.jpg not downloaded yet
2026-03-27 16:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/6.jpg not downloaded yet
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/7.jpg not downloaded yet
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/8.jpg not downloaded yet
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/9.jpg not downloaded yet
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/10.jpg not downloaded yet
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69143150>
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/7.jpg saved to cache
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:21 [ayvens.it] INFO: Found listing with ID: 1988942
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988942%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [ayvens.it] INFO: Scrape type for 1988942: 1
2026-03-27 16:34:21 [ayvens.it] INFO: Extracting data for car ID: 1988942
2026-03-27 16:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e8e9a6-d593-5780-96fa-c889d525de05 with identifier: 1988942
2026-03-27 16:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e8e9a6-d593-5780-96fa-c889d525de05 with scrape type 1
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/1.jpg not downloaded yet
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c0b010>
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/1.jpg saved to cache
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d84d0>
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/9.jpg saved to cache
2026-03-27 16:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b01f50>
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/2.jpg saved to cache
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f1550>
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/8.jpg saved to cache
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68455490>
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn6%252Fdf03e806558241409c1337aeeec614c2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/10.jpg saved to cache
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1
2026-03-27 16:34:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1, skipping ID generation
2026-03-27 16:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with scrape type 1
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 sending to next pipeline
2026-03-27 16:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1, identifier: 1988938
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1f690>
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/8.jpg saved to cache
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/2.jpg not downloaded yet
2026-03-27 16:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with identifier: 1988938
2026-03-27 16:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with identifier: 1988938
2026-03-27 16:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ab9566c9-ba37-51f3-aeee-fcee63a4c9f1 with identifier: 1988938 to the API
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'ab9566c9-ba37-51f3-aeee-fcee63a4c9f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA 1.0 Hybrid S&S 70cv E6.4 Van 2 posti Commercial hatch '
'5-door',
'odometer': 58059,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584453,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576005,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458842,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab9566c9-ba37-51f3-aeee-fcee63a4c9f1/ab9566c9-ba37-51f3-aeee-fcee63a4c9f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn6/df03e806558241409c1337aeeec614c2/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA 1.0 Hybrid S&S 70cv E6.4 Van 2 posti Commercial '
'hatch 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988938%27 HTTP/1.1" 200 None
2026-03-27 16:34:22 [ayvens.it] INFO: Saving data for 1988938: {'created_time': 1774629262.844399, 'last_price_update_time': 1774629262.844412, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988938') HTTP/1.1" 204 0
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/3.jpg not downloaded yet
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca3310>
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/6.jpg saved to cache
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/4.jpg not downloaded yet
2026-03-27 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/5.jpg not downloaded yet
2026-03-27 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/6.jpg not downloaded yet
2026-03-27 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/7.jpg not downloaded yet
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/8.jpg not downloaded yet
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/9.jpg not downloaded yet
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/10.jpg not downloaded yet
2026-03-27 16:34:23 [ayvens.it] INFO: Found listing with ID: 1988943
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988943%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [ayvens.it] INFO: Scrape type for 1988943: 1
2026-03-27 16:34:23 [ayvens.it] INFO: Extracting data for car ID: 1988943
2026-03-27 16:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b3f79e-b323-5be3-abb0-744d58884fd0 with identifier: 1988943
2026-03-27 16:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b3f79e-b323-5be3-abb0-744d58884fd0 with scrape type 1
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/1.jpg not downloaded yet
2026-03-27 16:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1d410>
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/10.jpg saved to cache
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9a0d0>
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv6%252Fd8b34761bd644bd798848e92ec1f3336%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/9.jpg saved to cache
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e971de7b-28e5-5f28-8084-c0a8925b244d
2026-03-27 16:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e971de7b-28e5-5f28-8084-c0a8925b244d, skipping ID generation
2026-03-27 16:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e971de7b-28e5-5f28-8084-c0a8925b244d with scrape type 1
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e971de7b-28e5-5f28-8084-c0a8925b244d sending to next pipeline
2026-03-27 16:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e971de7b-28e5-5f28-8084-c0a8925b244d, identifier: 1988939
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923c550>
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd9%252F08b58217c44e46f4adc967c4976675fb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/7.jpg saved to cache
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54426166-0f01-5a56-aa6d-822b7777a3e8
2026-03-27 16:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54426166-0f01-5a56-aa6d-822b7777a3e8, skipping ID generation
2026-03-27 16:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54426166-0f01-5a56-aa6d-822b7777a3e8 with scrape type 1
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54426166-0f01-5a56-aa6d-822b7777a3e8 sending to next pipeline
2026-03-27 16:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 54426166-0f01-5a56-aa6d-822b7777a3e8, identifier: 1988917
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/2.jpg not downloaded yet
2026-03-27 16:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e971de7b-28e5-5f28-8084-c0a8925b244d with identifier: 1988939
2026-03-27 16:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e971de7b-28e5-5f28-8084-c0a8925b244d with identifier: 1988939
2026-03-27 16:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e971de7b-28e5-5f28-8084-c0a8925b244d with identifier: 1988939 to the API
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'e971de7b-28e5-5f28-8084-c0a8925b244d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO 2.2 BLUEHDI 140 S&S 33 L2H2 FP',
'odometer': 127826,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468914,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 612058,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514677,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642343,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527498,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e971de7b-28e5-5f28-8084-c0a8925b244d/e971de7b-28e5-5f28-8084-c0a8925b244d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv6/d8b34761bd644bd798848e92ec1f3336/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-20',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO 2.2 BLUEHDI 140 S&S 33 L2H2 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988939%27 HTTP/1.1" 200 None
2026-03-27 16:34:23 [ayvens.it] INFO: Saving data for 1988939: {'created_time': 1774629263.797989, 'last_price_update_time': 1774629263.797999, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988939') HTTP/1.1" 204 0
2026-03-27 16:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 54426166-0f01-5a56-aa6d-822b7777a3e8 with identifier: 1988917
2026-03-27 16:34:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 54426166-0f01-5a56-aa6d-822b7777a3e8 with identifier: 1988917
2026-03-27 16:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 54426166-0f01-5a56-aa6d-822b7777a3e8 with identifier: 1988917 to the API
2026-03-27 16:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO SCURO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '54426166-0f01-5a56-aa6d-822b7777a3e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LEXUS',
'model': 'LEXUS UX HYBRID LUXURY 4WD FP',
'odometer': 70739,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 54,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540287,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540287,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571369,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532032,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555486,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54426166-0f01-5a56-aa6d-822b7777a3e8/54426166-0f01-5a56-aa6d-822b7777a3e8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd9/08b58217c44e46f4adc967c4976675fb/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'LEXUS LEXUS UX HYBRID LUXURY 4WD FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988917%27 HTTP/1.1" 200 None
2026-03-27 16:34:24 [ayvens.it] INFO: Saving data for 1988917: {'created_time': 1774629264.142604, 'last_price_update_time': 1774629264.142615, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988917') HTTP/1.1" 204 0
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b234d10>
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/2.jpg saved to cache
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c9ac50>
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/5.jpg saved to cache
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690f2a50>
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/4.jpg saved to cache
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6902b810>
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/3.jpg saved to cache
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f8d90>
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/1.jpg saved to cache
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/3.jpg not downloaded yet
2026-03-27 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/4.jpg not downloaded yet
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68543c10>
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/3.jpg saved to cache
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/5.jpg not downloaded yet
2026-03-27 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/6.jpg not downloaded yet
2026-03-27 16:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/7.jpg not downloaded yet
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/8.jpg not downloaded yet
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c7890>
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/2.jpg saved to cache
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/9.jpg not downloaded yet
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/10.jpg not downloaded yet
2026-03-27 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:25 [ayvens.it] INFO: Found listing with ID: 1988944
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988944%27 HTTP/1.1" 200 None
2026-03-27 16:34:25 [ayvens.it] INFO: Scrape type for 1988944: 1
2026-03-27 16:34:25 [ayvens.it] INFO: Extracting data for car ID: 1988944
2026-03-27 16:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de6b1fc4-f633-5b87-96e8-3d546606665f with identifier: 1988944
2026-03-27 16:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de6b1fc4-f633-5b87-96e8-3d546606665f with scrape type 1
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/1.jpg not downloaded yet
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69343e90>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/1.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ace610>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/4.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b8a450>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/9.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68baa910>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/10.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc1cd0>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/3.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b64d10>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/8.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/2.jpg not downloaded yet
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/3.jpg not downloaded yet
2026-03-27 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5cd50>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/1.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69141890>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/9.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/4.jpg not downloaded yet
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/5.jpg not downloaded yet
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/6.jpg not downloaded yet
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914e690>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/8.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bce090>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/10.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685446d0>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/4.jpg saved to cache
2026-03-27 16:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bd9410>
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/2.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/7.jpg not downloaded yet
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/8.jpg not downloaded yet
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff55d0>
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/3.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/9.jpg not downloaded yet
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/10.jpg not downloaded yet
2026-03-27 16:34:26 [ayvens.it] INFO: Found listing with ID: 1988945
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988945%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [ayvens.it] INFO: Scrape type for 1988945: 1
2026-03-27 16:34:26 [ayvens.it] INFO: Extracting data for car ID: 1988945
2026-03-27 16:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92c499e3-1879-5f3b-9c9c-d3600b1cc079 with identifier: 1988945
2026-03-27 16:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079 with scrape type 1
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/1.jpg not downloaded yet
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c78510>
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/10.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c55f90>
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/5.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/2.jpg not downloaded yet
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69008890>
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/2.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/3.jpg not downloaded yet
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68523150>
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/1.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5f7d0>
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/5.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f3a90>
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/8.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4aa50>
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/4.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/4.jpg not downloaded yet
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/5.jpg not downloaded yet
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1fdd0>
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/9.jpg saved to cache
2026-03-27 16:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/6.jpg not downloaded yet
2026-03-27 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/7.jpg not downloaded yet
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fec210>
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/7.jpg saved to cache
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcc1d0>
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/6.jpg saved to cache
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef5550>
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/8.jpg saved to cache
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4b190>
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/2.jpg saved to cache
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/8.jpg not downloaded yet
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b31290>
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/9.jpg saved to cache
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/9.jpg not downloaded yet
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/10.jpg not downloaded yet
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c357d0>
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F929b2228b721415baa3163a62fd35c75%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/10.jpg saved to cache
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74b3f79e-b323-5be3-abb0-744d58884fd0
2026-03-27 16:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74b3f79e-b323-5be3-abb0-744d58884fd0, skipping ID generation
2026-03-27 16:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b3f79e-b323-5be3-abb0-744d58884fd0 with scrape type 1
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74b3f79e-b323-5be3-abb0-744d58884fd0 sending to next pipeline
2026-03-27 16:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 74b3f79e-b323-5be3-abb0-744d58884fd0, identifier: 1988943
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcfb50>
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/1.jpg saved to cache
2026-03-27 16:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 74b3f79e-b323-5be3-abb0-744d58884fd0 with identifier: 1988943
2026-03-27 16:34:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 74b3f79e-b323-5be3-abb0-744d58884fd0 with identifier: 1988943
2026-03-27 16:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 74b3f79e-b323-5be3-abb0-744d58884fd0 with identifier: 1988943 to the API
2026-03-27 16:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio quarzo metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '74b3f79e-b323-5be3-abb0-744d58884fd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA WAGON 1.5 TSI EXECUTIVE SW 5-door (Euro 6D)',
'odometer': 38284,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 71,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464143,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590273,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b3f79e-b323-5be3-abb0-744d58884fd0/74b3f79e-b323-5be3-abb0-744d58884fd0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/929b2228b721415baa3163a62fd35c75/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA WAGON 1.5 TSI EXECUTIVE SW 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988943%27 HTTP/1.1" 200 None
2026-03-27 16:34:28 [ayvens.it] INFO: Saving data for 1988943: {'created_time': 1774629268.445295, 'last_price_update_time': 1774629268.445305, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988943') HTTP/1.1" 204 0
2026-03-27 16:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:28 [ayvens.it] INFO: Found listing with ID: 1988946
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988946%27 HTTP/1.1" 200 None
2026-03-27 16:34:28 [ayvens.it] INFO: Scrape type for 1988946: 1
2026-03-27 16:34:28 [ayvens.it] INFO: Extracting data for car ID: 1988946
2026-03-27 16:34:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc229385-b489-5edf-88a2-bec141a101c0 with identifier: 1988946
2026-03-27 16:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc229385-b489-5edf-88a2-bec141a101c0 with scrape type 1
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/1.jpg not downloaded yet
2026-03-27 16:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/2.jpg not downloaded yet
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcde10>
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/3.jpg saved to cache
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6860bb50>
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/7.jpg saved to cache
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/3.jpg not downloaded yet
2026-03-27 16:34:28 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/4.jpg not downloaded yet
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af6010>
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/5.jpg saved to cache
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6941bc50>
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/4.jpg saved to cache
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685411d0>
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/6.jpg saved to cache
2026-03-27 16:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c21150>
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/8.jpg saved to cache
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/5.jpg not downloaded yet
2026-03-27 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/6.jpg not downloaded yet
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079 due to Ignoring non-200 response
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914c9d0>
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/9.jpg saved to cache
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/7.jpg not downloaded yet
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/8.jpg not downloaded yet
2026-03-27 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/9.jpg not downloaded yet
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69281ad0>
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/7.jpg saved to cache
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/10.jpg not downloaded yet
2026-03-27 16:34:29 [ayvens.it] INFO: Found listing with ID: 1988947
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988947%27 HTTP/1.1" 200 None
2026-03-27 16:34:29 [ayvens.it] INFO: Scrape type for 1988947: 1
2026-03-27 16:34:29 [ayvens.it] INFO: Extracting data for car ID: 1988947
2026-03-27 16:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83321902-b8a4-5be9-9508-0adf8bdf3e11 with identifier: 1988947
2026-03-27 16:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83321902-b8a4-5be9-9508-0adf8bdf3e11 with scrape type 1
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/1.jpg not downloaded yet
2026-03-27 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6aa50>
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/3.jpg saved to cache
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb2410>
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/4.jpg saved to cache
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfdd50>
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/1.jpg saved to cache
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68608c50>
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd1%252F775b927d75de4e1c9910cbd7d0f527a3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/6.jpg saved to cache
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96e8e9a6-d593-5780-96fa-c889d525de05
2026-03-27 16:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96e8e9a6-d593-5780-96fa-c889d525de05, skipping ID generation
2026-03-27 16:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e8e9a6-d593-5780-96fa-c889d525de05 with scrape type 1
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96e8e9a6-d593-5780-96fa-c889d525de05 sending to next pipeline
2026-03-27 16:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 96e8e9a6-d593-5780-96fa-c889d525de05, identifier: 1988942
2026-03-27 16:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/2.jpg not downloaded yet
2026-03-27 16:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 96e8e9a6-d593-5780-96fa-c889d525de05 with identifier: 1988942
2026-03-27 16:34:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 96e8e9a6-d593-5780-96fa-c889d525de05 with identifier: 1988942
2026-03-27 16:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 96e8e9a6-d593-5780-96fa-c889d525de05 with identifier: 1988942 to the API
2026-03-27 16:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO CARRARA PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '96e8e9a6-d593-5780-96fa-c889d525de05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 (PC) 1.0 70CV IBRIDO LOUNGE FP',
'odometer': 77232,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1059123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1059123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1034741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534427,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e8e9a6-d593-5780-96fa-c889d525de05/96e8e9a6-d593-5780-96fa-c889d525de05_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293180,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd1/775b927d75de4e1c9910cbd7d0f527a3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 (PC) 1.0 70CV IBRIDO LOUNGE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988942%27 HTTP/1.1" 200 None
2026-03-27 16:34:30 [ayvens.it] INFO: Saving data for 1988942: {'created_time': 1774629270.141613, 'last_price_update_time': 1774629270.141624, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988942') HTTP/1.1" 204 0
2026-03-27 16:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/3.jpg not downloaded yet
2026-03-27 16:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/4.jpg not downloaded yet
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928df10>
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252Fd95cc980b25c4f15a018681d37f1d9c8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/10.jpg saved to cache
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de6b1fc4-f633-5b87-96e8-3d546606665f
2026-03-27 16:34:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de6b1fc4-f633-5b87-96e8-3d546606665f, skipping ID generation
2026-03-27 16:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de6b1fc4-f633-5b87-96e8-3d546606665f with scrape type 1
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de6b1fc4-f633-5b87-96e8-3d546606665f sending to next pipeline
2026-03-27 16:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: de6b1fc4-f633-5b87-96e8-3d546606665f, identifier: 1988944
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5d8d0>
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/5.jpg saved to cache
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e698ea810>
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/6.jpg saved to cache
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: de6b1fc4-f633-5b87-96e8-3d546606665f with identifier: 1988944
2026-03-27 16:34:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: de6b1fc4-f633-5b87-96e8-3d546606665f with identifier: 1988944
2026-03-27 16:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: de6b1fc4-f633-5b87-96e8-3d546606665f with identifier: 1988944 to the API
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO MADREPERLA MTZ SPECIALE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'de6b1fc4-f633-5b87-96e8-3d546606665f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 208 ALLURE PACK PURETECH 100 EAT8 S/S AUTO FP',
'odometer': 67788,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 57,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368194,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532698,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342341,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313909,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6b1fc4-f633-5b87-96e8-3d546606665f/de6b1fc4-f633-5b87-96e8-3d546606665f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702697,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/d95cc980b25c4f15a018681d37f1d9c8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 208 ALLURE PACK PURETECH 100 EAT8 S/S AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988944%27 HTTP/1.1" 200 None
2026-03-27 16:34:30 [ayvens.it] INFO: Saving data for 1988944: {'created_time': 1774629270.945219, 'last_price_update_time': 1774629270.945231, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988944') HTTP/1.1" 204 0
2026-03-27 16:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/5.jpg not downloaded yet
2026-03-27 16:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/6.jpg not downloaded yet
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914e0d0>
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/8.jpg saved to cache
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fca090>
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/7.jpg saved to cache
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/7.jpg not downloaded yet
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/8.jpg not downloaded yet
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0eb50>
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/10.jpg saved to cache
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b234cd0>
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/9.jpg saved to cache
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b2b550>
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F8e4cc8b0798a43ecbeabf8e264223cd6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/7.jpg saved to cache
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079
2026-03-27 16:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92c499e3-1879-5f3b-9c9c-d3600b1cc079, skipping ID generation
2026-03-27 16:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079 with scrape type 1
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92c499e3-1879-5f3b-9c9c-d3600b1cc079 sending to next pipeline
2026-03-27 16:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 92c499e3-1879-5f3b-9c9c-d3600b1cc079, identifier: 1988945
2026-03-27 16:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 92c499e3-1879-5f3b-9c9c-d3600b1cc079 with identifier: 1988945
2026-03-27 16:34:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 92c499e3-1879-5f3b-9c9c-d3600b1cc079 with identifier: 1988945
2026-03-27 16:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 92c499e3-1879-5f3b-9c9c-d3600b1cc079 with identifier: 1988945 to the API
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Aurora Grey micalizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '92c499e3-1879-5f3b-9c9c-d3600b1cc079',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'HYUNDAI I10 1.0 MPI Advanced Hatchback 5-door (Eur',
'odometer': 86336,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682487,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518801,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 466017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c499e3-1879-5f3b-9c9c-d3600b1cc079/92c499e3-1879-5f3b-9c9c-d3600b1cc079_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/8e4cc8b0798a43ecbeabf8e264223cd6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI HYUNDAI I10 1.0 MPI Advanced Hatchback 5-door (Eur -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988945%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [ayvens.it] INFO: Saving data for 1988945: {'created_time': 1774629271.822985, 'last_price_update_time': 1774629271.822997, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988945') HTTP/1.1" 204 0
2026-03-27 16:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/9.jpg not downloaded yet
2026-03-27 16:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/10.jpg not downloaded yet
2026-03-27 16:34:31 [ayvens.it] INFO: Found listing with ID: 1988948
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988948%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [ayvens.it] INFO: Scrape type for 1988948: 1
2026-03-27 16:34:31 [ayvens.it] INFO: Extracting data for car ID: 1988948
2026-03-27 16:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a275e513-bfeb-5dcf-8398-b80201c5ab24 with identifier: 1988948
2026-03-27 16:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a275e513-bfeb-5dcf-8398-b80201c5ab24 with scrape type 1
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/1.jpg not downloaded yet
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/2.jpg not downloaded yet
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/3.jpg not downloaded yet
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1ff50>
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/3.jpg saved to cache
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69514710>
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/2.jpg saved to cache
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/4.jpg not downloaded yet
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/5.jpg not downloaded yet
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/6.jpg not downloaded yet
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69028590>
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/1.jpg saved to cache
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69142e90>
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/4.jpg saved to cache
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/7.jpg not downloaded yet
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/8.jpg not downloaded yet
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/9.jpg not downloaded yet
2026-03-27 16:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/10.jpg not downloaded yet
2026-03-27 16:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:32 [ayvens.it] INFO: Found listing with ID: 1988949
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988949%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [ayvens.it] INFO: Scrape type for 1988949: 1
2026-03-27 16:34:32 [ayvens.it] INFO: Extracting data for car ID: 1988949
2026-03-27 16:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c927e841-108b-56fd-b4ce-39d73b6f1bfd with identifier: 1988949
2026-03-27 16:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c927e841-108b-56fd-b4ce-39d73b6f1bfd with scrape type 1
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/1.jpg not downloaded yet
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/2.jpg not downloaded yet
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/3.jpg not downloaded yet
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/4.jpg not downloaded yet
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c7bc10>
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/8.jpg saved to cache
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/5.jpg not downloaded yet
2026-03-27 16:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5f2d0>
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/5.jpg saved to cache
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd3510>
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/6.jpg saved to cache
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/6.jpg not downloaded yet
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/7.jpg not downloaded yet
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0d850>
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/4.jpg saved to cache
2026-03-27 16:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912e1d0>
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/3.jpg saved to cache
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69283910>
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/7.jpg saved to cache
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/8.jpg not downloaded yet
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/9.jpg not downloaded yet
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/10.jpg not downloaded yet
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [ayvens.it] INFO: Found listing with ID: 1988950
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988950%27 HTTP/1.1" 200 None
2026-03-27 16:34:33 [ayvens.it] INFO: Scrape type for 1988950: 1
2026-03-27 16:34:33 [ayvens.it] INFO: Extracting data for car ID: 1988950
2026-03-27 16:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8ad5fe1-8e20-57dc-88a6-b557c93c20fb with identifier: 1988950
2026-03-27 16:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb with scrape type 1
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/1.jpg not downloaded yet
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/2.jpg not downloaded yet
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/3.jpg not downloaded yet
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0e110>
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/2.jpg saved to cache
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/4.jpg not downloaded yet
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bd9990>
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/10.jpg saved to cache
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/5.jpg not downloaded yet
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc3190>
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/6.jpg saved to cache
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e7fd0>
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/8.jpg saved to cache
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d126d0>
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/1.jpg saved to cache
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853f7d0>
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt4%252F7e145c0ac00a48f68d6a06b38815d642%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/9.jpg saved to cache
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc229385-b489-5edf-88a2-bec141a101c0
2026-03-27 16:34:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc229385-b489-5edf-88a2-bec141a101c0, skipping ID generation
2026-03-27 16:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc229385-b489-5edf-88a2-bec141a101c0 with scrape type 1
2026-03-27 16:34:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc229385-b489-5edf-88a2-bec141a101c0 sending to next pipeline
2026-03-27 16:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cc229385-b489-5edf-88a2-bec141a101c0, identifier: 1988946
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69324c90>
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/5.jpg saved to cache
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692dcb90>
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/7.jpg saved to cache
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5ce50>
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/6.jpg saved to cache
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/6.jpg not downloaded yet
2026-03-27 16:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cc229385-b489-5edf-88a2-bec141a101c0 with identifier: 1988946
2026-03-27 16:34:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cc229385-b489-5edf-88a2-bec141a101c0 with identifier: 1988946
2026-03-27 16:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cc229385-b489-5edf-88a2-bec141a101c0 with identifier: 1988946 to the API
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO PIETRA',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'cc229385-b489-5edf-88a2-bec141a101c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LANCIA',
'model': 'LANCIA YPSILON (PC) 1.0 FIREFLY 70CV HYBRID ORO FP',
'odometer': 36848,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1076831,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 796886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 952090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 708708,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1039462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc229385-b489-5edf-88a2-bec141a101c0/cc229385-b489-5edf-88a2-bec141a101c0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726920,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt4/7e145c0ac00a48f68d6a06b38815d642/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'LANCIA LANCIA YPSILON (PC) 1.0 FIREFLY 70CV HYBRID ORO FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988946%27 HTTP/1.1" 200 None
2026-03-27 16:34:34 [ayvens.it] INFO: Saving data for 1988946: {'created_time': 1774629274.747725, 'last_price_update_time': 1774629274.747735, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988946') HTTP/1.1" 204 0
2026-03-27 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/7.jpg not downloaded yet
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd4b90>
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/8.jpg saved to cache
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/8.jpg not downloaded yet
2026-03-27 16:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/9.jpg not downloaded yet
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdfed0>
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/9.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/10.jpg not downloaded yet
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [ayvens.it] INFO: Found listing with ID: 1988951
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988951%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [ayvens.it] INFO: Scrape type for 1988951: 1
2026-03-27 16:34:35 [ayvens.it] INFO: Extracting data for car ID: 1988951
2026-03-27 16:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9 with identifier: 1988951
2026-03-27 16:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9 with scrape type 1
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/1.jpg not downloaded yet
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/2.jpg not downloaded yet
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68baa9d0>
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/9.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fea4d0>
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/3.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e5790>
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/4.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b85c8d0>
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/10.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e6050>
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/2.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/3.jpg not downloaded yet
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/4.jpg not downloaded yet
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/5.jpg not downloaded yet
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c22f50>
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/8.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c368d0>
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/7.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/6.jpg not downloaded yet
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/7.jpg not downloaded yet
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d236d0>
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/9.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694da950>
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/5.jpg saved to cache
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/8.jpg not downloaded yet
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/9.jpg not downloaded yet
2026-03-27 16:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/10.jpg not downloaded yet
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925f950>
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/4.jpg saved to cache
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69283810>
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/1.jpg saved to cache
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b8a1d0>
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/5.jpg saved to cache
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69300e10>
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/6.jpg saved to cache
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb56d0>
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/6.jpg saved to cache
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:36 [ayvens.it] INFO: Found listing with ID: 1988952
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988952%27 HTTP/1.1" 200 None
2026-03-27 16:34:36 [ayvens.it] INFO: Scrape type for 1988952: 1
2026-03-27 16:34:36 [ayvens.it] INFO: Extracting data for car ID: 1988952
2026-03-27 16:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with identifier: 1988952
2026-03-27 16:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with scrape type 1
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/1.jpg not downloaded yet
2026-03-27 16:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/2.jpg not downloaded yet
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a58850>
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/10.jpg saved to cache
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68530850>
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/3.jpg saved to cache
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68544d90>
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/2.jpg saved to cache
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/3.jpg not downloaded yet
2026-03-27 16:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/4.jpg not downloaded yet
2026-03-27 16:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/5.jpg not downloaded yet
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e695164d0>
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/7.jpg saved to cache
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/6.jpg not downloaded yet
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/7.jpg not downloaded yet
2026-03-27 16:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69282550>
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/10.jpg saved to cache
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c220d0>
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/6.jpg saved to cache
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d030d0>
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/7.jpg saved to cache
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69141b10>
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft7%252F6be9775bca61425b8d630d80e08264e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/1.jpg saved to cache
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c927e841-108b-56fd-b4ce-39d73b6f1bfd
2026-03-27 16:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c927e841-108b-56fd-b4ce-39d73b6f1bfd, skipping ID generation
2026-03-27 16:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c927e841-108b-56fd-b4ce-39d73b6f1bfd with scrape type 1
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c927e841-108b-56fd-b4ce-39d73b6f1bfd sending to next pipeline
2026-03-27 16:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c927e841-108b-56fd-b4ce-39d73b6f1bfd, identifier: 1988949
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/8.jpg not downloaded yet
2026-03-27 16:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c927e841-108b-56fd-b4ce-39d73b6f1bfd with identifier: 1988949
2026-03-27 16:34:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c927e841-108b-56fd-b4ce-39d73b6f1bfd with identifier: 1988949
2026-03-27 16:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c927e841-108b-56fd-b4ce-39d73b6f1bfd with identifier: 1988949 to the API
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Pull Me Over Red brilliant',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'c927e841-108b-56fd-b4ce-39d73b6f1bfd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL KARL 1.0 73cv Rocks MT5 Hatchback 5-door (Euro 6.2)',
'odometer': 69010,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 779577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471457,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c927e841-108b-56fd-b4ce-39d73b6f1bfd/c927e841-108b-56fd-b4ce-39d73b6f1bfd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765842,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft7/6be9775bca61425b8d630d80e08264e1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL KARL 1.0 73cv Rocks MT5 Hatchback 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988949%27 HTTP/1.1" 200 None
2026-03-27 16:34:38 [ayvens.it] INFO: Saving data for 1988949: {'created_time': 1774629278.032052, 'last_price_update_time': 1774629278.032065, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988949') HTTP/1.1" 204 0
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/9.jpg not downloaded yet
2026-03-27 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/10.jpg not downloaded yet
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b73690>
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/3.jpg saved to cache
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18490>
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/1.jpg saved to cache
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feda50>
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/4.jpg saved to cache
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:38 [ayvens.it] INFO: Found listing with ID: 1988953
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988953%27 HTTP/1.1" 200 None
2026-03-27 16:34:38 [ayvens.it] INFO: Scrape type for 1988953: 1
2026-03-27 16:34:38 [ayvens.it] INFO: Extracting data for car ID: 1988953
2026-03-27 16:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e4dd95-6716-53c2-aedf-859273b2edb6 with identifier: 1988953
2026-03-27 16:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e4dd95-6716-53c2-aedf-859273b2edb6 with scrape type 1
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/1.jpg not downloaded yet
2026-03-27 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/2.jpg not downloaded yet
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6a9ff310>
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/9.jpg saved to cache
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/3.jpg not downloaded yet
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/4.jpg not downloaded yet
2026-03-27 16:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/5.jpg not downloaded yet
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca1e50>
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/6.jpg saved to cache
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5df50>
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga4%252F97e07f96dc2f4e5e90e025dab6cbc5b5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/8.jpg saved to cache
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb
2026-03-27 16:34:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8ad5fe1-8e20-57dc-88a6-b557c93c20fb, skipping ID generation
2026-03-27 16:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb with scrape type 1
2026-03-27 16:34:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8ad5fe1-8e20-57dc-88a6-b557c93c20fb sending to next pipeline
2026-03-27 16:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d8ad5fe1-8e20-57dc-88a6-b557c93c20fb, identifier: 1988950
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b71350>
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/2.jpg saved to cache
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b56810>
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/5.jpg saved to cache
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d377d0>
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/7.jpg saved to cache
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916e710>
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/9.jpg saved to cache
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c79cd0>
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/5.jpg saved to cache
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d8ad5fe1-8e20-57dc-88a6-b557c93c20fb with identifier: 1988950
2026-03-27 16:34:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d8ad5fe1-8e20-57dc-88a6-b557c93c20fb with identifier: 1988950
2026-03-27 16:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d8ad5fe1-8e20-57dc-88a6-b557c93c20fb with identifier: 1988950 to the API
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco solido',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'electric',
'id': 'd8ad5fe1-8e20-57dc-88a6-b557c93c20fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN LEAF Business 40KWh Hatchback 5-door',
'odometer': 73578,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542560,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147190,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516683,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ad5fe1-8e20-57dc-88a6-b557c93c20fb/d8ad5fe1-8e20-57dc-88a6-b557c93c20fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273580,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga4/97e07f96dc2f4e5e90e025dab6cbc5b5/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-16',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN LEAF Business 40KWh Hatchback 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988950%27 HTTP/1.1" 200 None
2026-03-27 16:34:39 [ayvens.it] INFO: Saving data for 1988950: {'created_time': 1774629279.688219, 'last_price_update_time': 1774629279.688229, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988950') HTTP/1.1" 204 0
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/6.jpg not downloaded yet
2026-03-27 16:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/7.jpg not downloaded yet
2026-03-27 16:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68611310>
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/2.jpg saved to cache
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/8.jpg not downloaded yet
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/9.jpg not downloaded yet
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/10.jpg not downloaded yet
2026-03-27 16:34:39 [ayvens.it] INFO: Found listing with ID: 1988954
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988954%27 HTTP/1.1" 200 None
2026-03-27 16:34:39 [ayvens.it] INFO: Scrape type for 1988954: 1
2026-03-27 16:34:39 [ayvens.it] INFO: Extracting data for car ID: 1988954
2026-03-27 16:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 929b795f-0d34-5f05-9fff-7a261b83c347 with identifier: 1988954
2026-03-27 16:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929b795f-0d34-5f05-9fff-7a261b83c347 with scrape type 1
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/1.jpg not downloaded yet
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b65c50>
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/8.jpg saved to cache
2026-03-27 16:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/2.jpg not downloaded yet
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af6450>
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/1.jpg saved to cache
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6add4110>
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F189077e8c73f477bb12a97725cb7b020%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/10.jpg saved to cache
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9
2026-03-27 16:34:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9, skipping ID generation
2026-03-27 16:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9 with scrape type 1
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9 sending to next pipeline
2026-03-27 16:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9, identifier: 1988951
2026-03-27 16:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9 with identifier: 1988951
2026-03-27 16:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9 with identifier: 1988951
2026-03-27 16:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9 with identifier: 1988951 to the API
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero Mythos metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 35 TDI S tronic Business Sport utility vehicle 5-door (Euro '
'6D)',
'odometer': 128010,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 659679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608335,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528027,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397851,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9/a6bf2a9c-79ac-5cc3-b628-0f36e79a20a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/189077e8c73f477bb12a97725cb7b020/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 35 TDI S tronic Business Sport utility vehicle 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988951%27 HTTP/1.1" 200 None
2026-03-27 16:34:40 [ayvens.it] INFO: Saving data for 1988951: {'created_time': 1774629280.632885, 'last_price_update_time': 1774629280.632895, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988951') HTTP/1.1" 204 0
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/3.jpg not downloaded yet
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f064d0>
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/4.jpg saved to cache
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fea1d0>
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/3.jpg saved to cache
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e686134d0>
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/6.jpg saved to cache
2026-03-27 16:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b64150>
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/5.jpg saved to cache
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c68410>
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/9.jpg saved to cache
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/4.jpg not downloaded yet
2026-03-27 16:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/5.jpg not downloaded yet
2026-03-27 16:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/6.jpg not downloaded yet
2026-03-27 16:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/7.jpg not downloaded yet
2026-03-27 16:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/8.jpg not downloaded yet
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69280710>
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/10.jpg saved to cache
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69280f90>
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/7.jpg saved to cache
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/9.jpg not downloaded yet
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f88d0>
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/2.jpg saved to cache
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/10.jpg not downloaded yet
2026-03-27 16:34:41 [ayvens.it] INFO: Found listing with ID: 1988955
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988955%27 HTTP/1.1" 200 None
2026-03-27 16:34:41 [ayvens.it] INFO: Scrape type for 1988955: 1
2026-03-27 16:34:41 [ayvens.it] INFO: Extracting data for car ID: 1988955
2026-03-27 16:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with identifier: 1988955
2026-03-27 16:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with scrape type 1
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/1.jpg not downloaded yet
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c84390>
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/3.jpg saved to cache
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fedf10>
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/4.jpg saved to cache
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc3f10>
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252Fec05c4e121ed4cef907ed7a1dab77ab4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/8.jpg saved to cache
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3
2026-03-27 16:34:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1db646ef-d42c-5ca3-a556-a3832d5be3f3, skipping ID generation
2026-03-27 16:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with scrape type 1
2026-03-27 16:34:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1db646ef-d42c-5ca3-a556-a3832d5be3f3 sending to next pipeline
2026-03-27 16:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1db646ef-d42c-5ca3-a556-a3832d5be3f3, identifier: 1988952
2026-03-27 16:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9bcd0>
2026-03-27 16:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/4.jpg saved to cache
2026-03-27 16:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d00190>
2026-03-27 16:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/1.jpg saved to cache
2026-03-27 16:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with identifier: 1988952
2026-03-27 16:34:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with identifier: 1988952
2026-03-27 16:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1db646ef-d42c-5ca3-a556-a3832d5be3f3 with identifier: 1988952 to the API
2026-03-27 16:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ALPINE WHITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '1db646ef-d42c-5ca3-a556-a3832d5be3f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP RENEGADE CONSIP 1.3 T4 PHEV 190CV LIMITED 4XE AUTO FP',
'odometer': 40915,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327020,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543089,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266249,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556258,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db646ef-d42c-5ca3-a556-a3832d5be3f3/1db646ef-d42c-5ca3-a556-a3832d5be3f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/ec05c4e121ed4cef907ed7a1dab77ab4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP RENEGADE CONSIP 1.3 T4 PHEV 190CV LIMITED 4XE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988952%27 HTTP/1.1" 200 None
2026-03-27 16:34:43 [ayvens.it] INFO: Saving data for 1988952: {'created_time': 1774629283.533088, 'last_price_update_time': 1774629283.533099, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988952') HTTP/1.1" 204 0
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/2.jpg not downloaded yet
2026-03-27 16:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/3.jpg not downloaded yet
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/4.jpg not downloaded yet
2026-03-27 16:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/5.jpg not downloaded yet
2026-03-27 16:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/6.jpg not downloaded yet
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/7.jpg not downloaded yet
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/8.jpg not downloaded yet
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/9.jpg not downloaded yet
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b65c10>
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/5.jpg saved to cache
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69281950>
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fx8g%252Fb4486cdc9afd4ad69fe94bc4a19f53e4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/10.jpg saved to cache
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83321902-b8a4-5be9-9508-0adf8bdf3e11
2026-03-27 16:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83321902-b8a4-5be9-9508-0adf8bdf3e11, skipping ID generation
2026-03-27 16:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83321902-b8a4-5be9-9508-0adf8bdf3e11 with scrape type 1
2026-03-27 16:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83321902-b8a4-5be9-9508-0adf8bdf3e11 sending to next pipeline
2026-03-27 16:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 83321902-b8a4-5be9-9508-0adf8bdf3e11, identifier: 1988947
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb75d0>
2026-03-27 16:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/2.jpg saved to cache
2026-03-27 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69280690>
2026-03-27 16:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr4%252F598227f379a847d69b21e9e8cd1e76e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/5.jpg saved to cache
2026-03-27 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15a753d9-cf3f-5b16-8913-6b05b9684e90
2026-03-27 16:34:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15a753d9-cf3f-5b16-8913-6b05b9684e90, skipping ID generation
2026-03-27 16:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a753d9-cf3f-5b16-8913-6b05b9684e90 with scrape type 1
2026-03-27 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15a753d9-cf3f-5b16-8913-6b05b9684e90 sending to next pipeline
2026-03-27 16:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 15a753d9-cf3f-5b16-8913-6b05b9684e90, identifier: 1988941
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/10.jpg not downloaded yet
2026-03-27 16:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 83321902-b8a4-5be9-9508-0adf8bdf3e11 with identifier: 1988947
2026-03-27 16:34:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 83321902-b8a4-5be9-9508-0adf8bdf3e11 with identifier: 1988947
2026-03-27 16:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 83321902-b8a4-5be9-9508-0adf8bdf3e11 with identifier: 1988947 to the API
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'r Comment',
'currency': 'EUR',
'doors_number': 2,
'engine': '0.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '83321902-b8a4-5be9-9508-0adf8bdf3e11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AIXAM',
'model': "AIXAM SENSATION COUPE' GTI (Euro 4)",
'odometer': 33148,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 770158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536190,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243460,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83321902-b8a4-5be9-9508-0adf8bdf3e11/83321902-b8a4-5be9-9508-0adf8bdf3e11_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412749,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/x8g/b4486cdc9afd4ad69fe94bc4a19f53e4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-26',
'seats_number': 5,
'seller_name': None,
'title': "AIXAM AIXAM SENSATION COUPE' GTI (Euro 4) -",
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988947%27 HTTP/1.1" 200 None
2026-03-27 16:34:44 [ayvens.it] INFO: Saving data for 1988947: {'created_time': 1774629284.622234, 'last_price_update_time': 1774629284.622244, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988947') HTTP/1.1" 204 0
2026-03-27 16:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 15a753d9-cf3f-5b16-8913-6b05b9684e90 with identifier: 1988941
2026-03-27 16:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 15a753d9-cf3f-5b16-8913-6b05b9684e90 with identifier: 1988941
2026-03-27 16:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 15a753d9-cf3f-5b16-8913-6b05b9684e90 with identifier: 1988941 to the API
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol_lpg',
'id': '15a753d9-cf3f-5b16-8913-6b05b9684e90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP12 1.2 69CV EASYPOWER E6 EASY FP',
'odometer': 88632,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259330,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267949,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524635,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a753d9-cf3f-5b16-8913-6b05b9684e90/15a753d9-cf3f-5b16-8913-6b05b9684e90_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218340,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr4/598227f379a847d69b21e9e8cd1e76e7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP12 1.2 69CV EASYPOWER E6 EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988941%27 HTTP/1.1" 200 None
2026-03-27 16:34:44 [ayvens.it] INFO: Saving data for 1988941: {'created_time': 1774629284.957348, 'last_price_update_time': 1774629284.957358, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988941') HTTP/1.1" 204 0
2026-03-27 16:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:44 [ayvens.it] INFO: Found listing with ID: 1988956
2026-03-27 16:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988956%27 HTTP/1.1" 200 None
2026-03-27 16:34:45 [ayvens.it] INFO: Scrape type for 1988956: 1
2026-03-27 16:34:45 [ayvens.it] INFO: Extracting data for car ID: 1988956
2026-03-27 16:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b21c9297-2aab-5439-b236-62e408f17181 with identifier: 1988956
2026-03-27 16:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b21c9297-2aab-5439-b236-62e408f17181 with scrape type 1
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/1.jpg not downloaded yet
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b3f9d0>
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/6.jpg saved to cache
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b83350>
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/3.jpg saved to cache
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcf410>
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/7.jpg saved to cache
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec31d0>
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr1%252F3bff4b9bfc0941149ea3aa813e1b4594%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/1.jpg saved to cache
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a275e513-bfeb-5dcf-8398-b80201c5ab24
2026-03-27 16:34:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a275e513-bfeb-5dcf-8398-b80201c5ab24, skipping ID generation
2026-03-27 16:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a275e513-bfeb-5dcf-8398-b80201c5ab24 with scrape type 1
2026-03-27 16:34:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a275e513-bfeb-5dcf-8398-b80201c5ab24 sending to next pipeline
2026-03-27 16:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a275e513-bfeb-5dcf-8398-b80201c5ab24, identifier: 1988948
2026-03-27 16:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a275e513-bfeb-5dcf-8398-b80201c5ab24 with identifier: 1988948
2026-03-27 16:34:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a275e513-bfeb-5dcf-8398-b80201c5ab24 with identifier: 1988948
2026-03-27 16:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a275e513-bfeb-5dcf-8398-b80201c5ab24 with identifier: 1988948 to the API
2026-03-27 16:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio nano met',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'a275e513-bfeb-5dcf-8398-b80201c5ab24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A1 1.0 TFSI 60kW Hatchback 3-door',
'odometer': 75753,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 860617,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a275e513-bfeb-5dcf-8398-b80201c5ab24/a275e513-bfeb-5dcf-8398-b80201c5ab24_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr1/3bff4b9bfc0941149ea3aa813e1b4594/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A1 1.0 TFSI 60kW Hatchback 3-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988948%27 HTTP/1.1" 200 None
2026-03-27 16:34:46 [ayvens.it] INFO: Saving data for 1988948: {'created_time': 1774629286.236295, 'last_price_update_time': 1774629286.236306, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988948') HTTP/1.1" 204 0
2026-03-27 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/2.jpg not downloaded yet
2026-03-27 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/3.jpg not downloaded yet
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f7710>
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/2.jpg saved to cache
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/4.jpg not downloaded yet
2026-03-27 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/5.jpg not downloaded yet
2026-03-27 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/6.jpg not downloaded yet
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f0b10>
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/4.jpg saved to cache
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2e550>
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/7.jpg saved to cache
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/7.jpg not downloaded yet
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad10e50>
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/5.jpg saved to cache
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69044690>
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/3.jpg saved to cache
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/8.jpg not downloaded yet
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aeba90>
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/10.jpg saved to cache
2026-03-27 16:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69283310>
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/1.jpg saved to cache
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690909d0>
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/6.jpg saved to cache
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/9.jpg not downloaded yet
2026-03-27 16:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/10.jpg not downloaded yet
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d444d0>
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/1.jpg saved to cache
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:47 [ayvens.it] INFO: Found listing with ID: 1988957
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988957%27 HTTP/1.1" 200 None
2026-03-27 16:34:47 [ayvens.it] INFO: Scrape type for 1988957: 1
2026-03-27 16:34:47 [ayvens.it] INFO: Extracting data for car ID: 1988957
2026-03-27 16:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25812a36-404f-5fd2-a60d-14a5f17164c2 with identifier: 1988957
2026-03-27 16:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25812a36-404f-5fd2-a60d-14a5f17164c2 with scrape type 1
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/1.jpg not downloaded yet
2026-03-27 16:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/2.jpg not downloaded yet
2026-03-27 16:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68533710>
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/10.jpg saved to cache
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68610a90>
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/9.jpg saved to cache
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/3.jpg not downloaded yet
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/4.jpg not downloaded yet
2026-03-27 16:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/5.jpg not downloaded yet
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d23e50>
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/3.jpg saved to cache
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb6950>
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/4.jpg saved to cache
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cce9d0>
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/10.jpg saved to cache
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2f10>
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp0%252F9fa14b6292304ed2b8cedc243fa98407%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/8.jpg saved to cache
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 929b795f-0d34-5f05-9fff-7a261b83c347
2026-03-27 16:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 929b795f-0d34-5f05-9fff-7a261b83c347, skipping ID generation
2026-03-27 16:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929b795f-0d34-5f05-9fff-7a261b83c347 with scrape type 1
2026-03-27 16:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 929b795f-0d34-5f05-9fff-7a261b83c347 sending to next pipeline
2026-03-27 16:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 929b795f-0d34-5f05-9fff-7a261b83c347, identifier: 1988954
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69342fd0>
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/2.jpg saved to cache
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 929b795f-0d34-5f05-9fff-7a261b83c347 with identifier: 1988954
2026-03-27 16:34:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 929b795f-0d34-5f05-9fff-7a261b83c347 with identifier: 1988954
2026-03-27 16:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 929b795f-0d34-5f05-9fff-7a261b83c347 with identifier: 1988954 to the API
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GHIACCIO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '929b795f-0d34-5f05-9fff-7a261b83c347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT MEGANE SW (PC) 1.5 DCI 85KW BLUE EQUILIBRE EDC FP',
'odometer': 111127,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211423,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398604,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929b795f-0d34-5f05-9fff-7a261b83c347/929b795f-0d34-5f05-9fff-7a261b83c347_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380443,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp0/9fa14b6292304ed2b8cedc243fa98407/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT MEGANE SW (PC) 1.5 DCI 85KW BLUE EQUILIBRE EDC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988954%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [ayvens.it] INFO: Saving data for 1988954: {'created_time': 1774629288.470464, 'last_price_update_time': 1774629288.470474, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988954') HTTP/1.1" 204 0
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/6.jpg not downloaded yet
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/7.jpg not downloaded yet
2026-03-27 16:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692dc610>
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/9.jpg saved to cache
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/8.jpg not downloaded yet
2026-03-27 16:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/9.jpg not downloaded yet
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/10.jpg not downloaded yet
2026-03-27 16:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:48 [ayvens.it] INFO: Found listing with ID: 1988958
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988958%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [ayvens.it] INFO: Scrape type for 1988958: 1
2026-03-27 16:34:48 [ayvens.it] INFO: Extracting data for car ID: 1988958
2026-03-27 16:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with identifier: 1988958
2026-03-27 16:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with scrape type 1
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/1.jpg not downloaded yet
2026-03-27 16:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfda90>
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/7.jpg saved to cache
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/2.jpg not downloaded yet
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/3.jpg not downloaded yet
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/4.jpg not downloaded yet
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca3cd0>
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/1.jpg saved to cache
2026-03-27 16:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a58790>
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/2.jpg saved to cache
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c21cd0>
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/8.jpg saved to cache
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c68d90>
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/4.jpg saved to cache
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/5.jpg not downloaded yet
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7d8d0>
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/3.jpg saved to cache
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684fa450>
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/5.jpg saved to cache
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68aebdd0>
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/6.jpg saved to cache
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/6.jpg not downloaded yet
2026-03-27 16:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/7.jpg not downloaded yet
2026-03-27 16:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/8.jpg not downloaded yet
2026-03-27 16:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/9.jpg not downloaded yet
2026-03-27 16:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/10.jpg not downloaded yet
2026-03-27 16:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd4050>
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/9.jpg saved to cache
2026-03-27 16:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:49 [ayvens.it] INFO: Found listing with ID: 1988959
2026-03-27 16:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988959%27 HTTP/1.1" 200 None
2026-03-27 16:34:50 [ayvens.it] INFO: Scrape type for 1988959: 1
2026-03-27 16:34:50 [ayvens.it] INFO: Extracting data for car ID: 1988959
2026-03-27 16:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92e97984-3c60-5ae7-8361-7f46776a7fa3 with identifier: 1988959
2026-03-27 16:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e97984-3c60-5ae7-8361-7f46776a7fa3 with scrape type 1
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/1.jpg not downloaded yet
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bef010>
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/8.jpg saved to cache
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68522550>
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/10.jpg saved to cache
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/2.jpg not downloaded yet
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/3.jpg not downloaded yet
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef68d0>
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/6.jpg saved to cache
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b32990>
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/4.jpg saved to cache
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68610890>
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx6%252F47116aa66b7f42e1a9a9088fbaf85131%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/7.jpg saved to cache
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b21c9297-2aab-5439-b236-62e408f17181
2026-03-27 16:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b21c9297-2aab-5439-b236-62e408f17181, skipping ID generation
2026-03-27 16:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b21c9297-2aab-5439-b236-62e408f17181 with scrape type 1
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b21c9297-2aab-5439-b236-62e408f17181 sending to next pipeline
2026-03-27 16:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b21c9297-2aab-5439-b236-62e408f17181, identifier: 1988956
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912d7d0>
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/1.jpg saved to cache
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914e410>
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp4%252Fa9106f566e6f4407a1bc89767a5ce9d7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/5.jpg saved to cache
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5
2026-03-27 16:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5, skipping ID generation
2026-03-27 16:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with scrape type 1
2026-03-27 16:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 sending to next pipeline
2026-03-27 16:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5, identifier: 1988955
2026-03-27 16:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b21c9297-2aab-5439-b236-62e408f17181 with identifier: 1988956
2026-03-27 16:34:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b21c9297-2aab-5439-b236-62e408f17181 with identifier: 1988956
2026-03-27 16:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b21c9297-2aab-5439-b236-62e408f17181 with identifier: 1988956 to the API
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'OSMIUM GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'b21c9297-2aab-5439-b236-62e408f17181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC90 T8 Twin Engine AWD Geartr.7p.Inscription Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 117840,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 75,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764495,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764495,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 699357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 659263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584734,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689945,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b21c9297-2aab-5439-b236-62e408f17181/b21c9297-2aab-5439-b236-62e408f17181_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx6/47116aa66b7f42e1a9a9088fbaf85131/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC90 T8 Twin Engine AWD Geartr.7p.Inscription Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988956%27 HTTP/1.1" 200 None
2026-03-27 16:34:51 [ayvens.it] INFO: Saving data for 1988956: {'created_time': 1774629291.367373, 'last_price_update_time': 1774629291.367386, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988956') HTTP/1.1" 204 0
2026-03-27 16:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with identifier: 1988955
2026-03-27 16:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with identifier: 1988955
2026-03-27 16:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 14f4c1e9-3777-50bd-a1b5-1f001441b2b5 with identifier: 1988955 to the API
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '14f4c1e9-3777-50bd-a1b5-1f001441b2b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 61878,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726394,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720230,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f4c1e9-3777-50bd-a1b5-1f001441b2b5/14f4c1e9-3777-50bd-a1b5-1f001441b2b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp4/a9106f566e6f4407a1bc89767a5ce9d7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988955%27 HTTP/1.1" 200 None
2026-03-27 16:34:51 [ayvens.it] INFO: Saving data for 1988955: {'created_time': 1774629291.641499, 'last_price_update_time': 1774629291.64151, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988955') HTTP/1.1" 204 0
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/4.jpg not downloaded yet
2026-03-27 16:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/5.jpg not downloaded yet
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6af9c5d0>
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/6.jpg saved to cache
2026-03-27 16:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/6.jpg not downloaded yet
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/7.jpg not downloaded yet
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/8.jpg not downloaded yet
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec1550>
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/7.jpg saved to cache
2026-03-27 16:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d37990>
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/8.jpg saved to cache
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/9.jpg not downloaded yet
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6941ab10>
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/5.jpg saved to cache
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/10.jpg not downloaded yet
2026-03-27 16:34:52 [ayvens.it] INFO: Found listing with ID: 1988960
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988960%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [ayvens.it] INFO: Scrape type for 1988960: 1
2026-03-27 16:34:52 [ayvens.it] INFO: Extracting data for car ID: 1988960
2026-03-27 16:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with identifier: 1988960
2026-03-27 16:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with scrape type 1
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/1.jpg not downloaded yet
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff70d0>
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/3.jpg saved to cache
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9acd0>
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/5.jpg saved to cache
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e689559d0>
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/4.jpg saved to cache
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/2.jpg not downloaded yet
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b64ed0>
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/2.jpg saved to cache
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/3.jpg not downloaded yet
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/4.jpg not downloaded yet
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/5.jpg not downloaded yet
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/6.jpg not downloaded yet
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c35510>
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/6.jpg saved to cache
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916fd10>
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/8.jpg saved to cache
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/7.jpg not downloaded yet
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/8.jpg not downloaded yet
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/9.jpg not downloaded yet
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692ddfd0>
2026-03-27 16:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/7.jpg saved to cache
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68611710>
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/1.jpg saved to cache
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e59d0>
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/2.jpg saved to cache
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef4b50>
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/1.jpg saved to cache
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/10.jpg not downloaded yet
2026-03-27 16:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:53 [ayvens.it] INFO: Found listing with ID: 1988961
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988961%27 HTTP/1.1" 200 None
2026-03-27 16:34:53 [ayvens.it] INFO: Scrape type for 1988961: 1
2026-03-27 16:34:53 [ayvens.it] INFO: Extracting data for car ID: 1988961
2026-03-27 16:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with identifier: 1988961
2026-03-27 16:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with scrape type 1
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/1.jpg not downloaded yet
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e7250>
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/10.jpg saved to cache
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/2.jpg not downloaded yet
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/3.jpg not downloaded yet
2026-03-27 16:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/4.jpg not downloaded yet
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1ca10>
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/10.jpg saved to cache
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68608d10>
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/3.jpg saved to cache
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d13190>
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252F4771b7d7649a4c739c91a126ceabc66c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/9.jpg saved to cache
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3
2026-03-27 16:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3fda564-e6a5-5114-a0e6-852d4adbc8c3, skipping ID generation
2026-03-27 16:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with scrape type 1
2026-03-27 16:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3fda564-e6a5-5114-a0e6-852d4adbc8c3 sending to next pipeline
2026-03-27 16:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d3fda564-e6a5-5114-a0e6-852d4adbc8c3, identifier: 1988958
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916f650>
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/4.jpg saved to cache
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c86ad0>
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/5.jpg saved to cache
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4b190>
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/7.jpg saved to cache
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfd310>
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/6.jpg saved to cache
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with identifier: 1988958
2026-03-27 16:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with identifier: 1988958
2026-03-27 16:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d3fda564-e6a5-5114-a0e6-852d4adbc8c3 with identifier: 1988958 to the API
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SANTORINI BLACK MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'd3fda564-e6a5-5114-a0e6-852d4adbc8c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 2.0 D200 MHEV S AWD AUTO FP',
'odometer': 107704,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 823917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 822750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 823917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 869861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 846942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3fda564-e6a5-5114-a0e6-852d4adbc8c3/d3fda564-e6a5-5114-a0e6-852d4adbc8c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/4771b7d7649a4c739c91a126ceabc66c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 2.0 D200 MHEV S AWD AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988958%27 HTTP/1.1" 200 None
2026-03-27 16:34:54 [ayvens.it] INFO: Saving data for 1988958: {'created_time': 1774629294.665827, 'last_price_update_time': 1774629294.665836, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988958') HTTP/1.1" 204 0
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/5.jpg not downloaded yet
2026-03-27 16:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/6.jpg not downloaded yet
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b4a110>
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/9.jpg saved to cache
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/7.jpg not downloaded yet
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/8.jpg not downloaded yet
2026-03-27 16:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/9.jpg not downloaded yet
2026-03-27 16:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b01010>
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/8.jpg saved to cache
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb1410>
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F136bb54e76a04d6eb4cda7b52bc49826%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/10.jpg saved to cache
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92e97984-3c60-5ae7-8361-7f46776a7fa3
2026-03-27 16:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92e97984-3c60-5ae7-8361-7f46776a7fa3, skipping ID generation
2026-03-27 16:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e97984-3c60-5ae7-8361-7f46776a7fa3 with scrape type 1
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92e97984-3c60-5ae7-8361-7f46776a7fa3 sending to next pipeline
2026-03-27 16:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 92e97984-3c60-5ae7-8361-7f46776a7fa3, identifier: 1988959
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/10.jpg not downloaded yet
2026-03-27 16:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 92e97984-3c60-5ae7-8361-7f46776a7fa3 with identifier: 1988959
2026-03-27 16:34:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 92e97984-3c60-5ae7-8361-7f46776a7fa3 with identifier: 1988959
2026-03-27 16:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 92e97984-3c60-5ae7-8361-7f46776a7fa3 with identifier: 1988959 to the API
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO CRISTALLO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '92e97984-3c60-5ae7-8361-7f46776a7fa3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSSBACK E-TENSE AUTOMATICA BUSINESS FP(PC) FP',
'odometer': 105735,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441650,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468176,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491954,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92e97984-3c60-5ae7-8361-7f46776a7fa3/92e97984-3c60-5ae7-8361-7f46776a7fa3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386706,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/136bb54e76a04d6eb4cda7b52bc49826/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSSBACK E-TENSE AUTOMATICA BUSINESS FP(PC) '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988959%27 HTTP/1.1" 200 None
2026-03-27 16:34:55 [ayvens.it] INFO: Saving data for 1988959: {'created_time': 1774629295.464425, 'last_price_update_time': 1774629295.464435, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988959') HTTP/1.1" 204 0
2026-03-27 16:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:55 [ayvens.it] INFO: Found listing with ID: 1988962
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988962%27 HTTP/1.1" 200 None
2026-03-27 16:34:55 [ayvens.it] INFO: Scrape type for 1988962: 1
2026-03-27 16:34:55 [ayvens.it] INFO: Extracting data for car ID: 1988962
2026-03-27 16:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a12546fb-f357-594e-bbea-faeef33b4a72 with identifier: 1988962
2026-03-27 16:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a12546fb-f357-594e-bbea-faeef33b4a72 with scrape type 1
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/1.jpg not downloaded yet
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/2.jpg not downloaded yet
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad10f10>
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/9.jpg saved to cache
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b29110>
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/2.jpg saved to cache
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/3.jpg not downloaded yet
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/4.jpg not downloaded yet
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690f2c90>
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/1.jpg saved to cache
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69324990>
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/4.jpg saved to cache
2026-03-27 16:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691cb1d0>
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/3.jpg saved to cache
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68454f10>
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/6.jpg saved to cache
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/5.jpg not downloaded yet
2026-03-27 16:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/6.jpg not downloaded yet
2026-03-27 16:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/7.jpg not downloaded yet
2026-03-27 16:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/8.jpg not downloaded yet
2026-03-27 16:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/9.jpg not downloaded yet
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/10.jpg not downloaded yet
2026-03-27 16:34:56 [ayvens.it] INFO: Found listing with ID: 1988963
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988963%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [ayvens.it] INFO: Scrape type for 1988963: 1
2026-03-27 16:34:56 [ayvens.it] INFO: Extracting data for car ID: 1988963
2026-03-27 16:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a3271e-25b7-5f7a-aff8-28aa46299a87 with identifier: 1988963
2026-03-27 16:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a3271e-25b7-5f7a-aff8-28aa46299a87 with scrape type 1
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/1.jpg not downloaded yet
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef5a10>
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/8.jpg saved to cache
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69325ad0>
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/9.jpg saved to cache
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/2.jpg not downloaded yet
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/3.jpg not downloaded yet
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b4a110>
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/5.jpg saved to cache
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69324690>
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/7.jpg saved to cache
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925f0d0>
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fd6e35a2a8e154d848413d7d198c6379a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/10.jpg saved to cache
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272
2026-03-27 16:34:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25ed13e5-aeaa-5bf4-a336-be76cf36f272, skipping ID generation
2026-03-27 16:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with scrape type 1
2026-03-27 16:34:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25ed13e5-aeaa-5bf4-a336-be76cf36f272 sending to next pipeline
2026-03-27 16:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 25ed13e5-aeaa-5bf4-a336-be76cf36f272, identifier: 1988960
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69342890>
2026-03-27 16:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/2.jpg saved to cache
2026-03-27 16:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b01d90>
2026-03-27 16:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F1c3eb0de48c94cc6b34d9280220ce5e4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/3.jpg saved to cache
2026-03-27 16:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25812a36-404f-5fd2-a60d-14a5f17164c2
2026-03-27 16:34:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25812a36-404f-5fd2-a60d-14a5f17164c2, skipping ID generation
2026-03-27 16:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25812a36-404f-5fd2-a60d-14a5f17164c2 with scrape type 1
2026-03-27 16:34:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25812a36-404f-5fd2-a60d-14a5f17164c2 sending to next pipeline
2026-03-27 16:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 25812a36-404f-5fd2-a60d-14a5f17164c2, identifier: 1988957
2026-03-27 16:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7d850>
2026-03-27 16:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/3.jpg saved to cache
2026-03-27 16:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with identifier: 1988960
2026-03-27 16:34:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with identifier: 1988960
2026-03-27 16:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 25ed13e5-aeaa-5bf4-a336-be76cf36f272 with identifier: 1988960 to the API
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MOONWALK GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '25ed13e5-aeaa-5bf4-a336-be76cf36f272',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MINI',
'model': 'MINI COUNTRYMAN Cooper S E ALL4 Business autom. Hatchback 5-door '
'(Euro 6.2)',
'odometer': 140404,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 844035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 768908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 817750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703899,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed13e5-aeaa-5bf4-a336-be76cf36f272/25ed13e5-aeaa-5bf4-a336-be76cf36f272_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/d6e35a2a8e154d848413d7d198c6379a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'MINI MINI COUNTRYMAN Cooper S E ALL4 Business autom. Hatchback '
'5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988960%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [ayvens.it] INFO: Saving data for 1988960: {'created_time': 1774629298.092601, 'last_price_update_time': 1774629298.092617, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988960') HTTP/1.1" 204 0
2026-03-27 16:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 25812a36-404f-5fd2-a60d-14a5f17164c2 with identifier: 1988957
2026-03-27 16:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 25812a36-404f-5fd2-a60d-14a5f17164c2 with identifier: 1988957
2026-03-27 16:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 25812a36-404f-5fd2-a60d-14a5f17164c2 with identifier: 1988957 to the API
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO CRISTALLO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '25812a36-404f-5fd2-a60d-14a5f17164c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) FP',
'odometer': 78538,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706493,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682907,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567874,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25812a36-404f-5fd2-a60d-14a5f17164c2/25812a36-404f-5fd2-a60d-14a5f17164c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525429,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/1c3eb0de48c94cc6b34d9280220ce5e4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988957%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [ayvens.it] INFO: Saving data for 1988957: {'created_time': 1774629298.389523, 'last_price_update_time': 1774629298.389533, 'auction_closing_time': 1774944000.0}
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988957') HTTP/1.1" 204 0
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/4.jpg not downloaded yet
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/5.jpg not downloaded yet
2026-03-27 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/6.jpg not downloaded yet
2026-03-27 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/7.jpg not downloaded yet
2026-03-27 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/8.jpg not downloaded yet
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/9.jpg not downloaded yet
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/10.jpg not downloaded yet
2026-03-27 16:34:58 [ayvens.it] INFO: Found listing with ID: 1988964
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988964%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [ayvens.it] INFO: Scrape type for 1988964: 1
2026-03-27 16:34:58 [ayvens.it] INFO: Extracting data for car ID: 1988964
2026-03-27 16:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46e9d87-218d-517b-b7f3-56f47d1410fe with identifier: 1988964
2026-03-27 16:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46e9d87-218d-517b-b7f3-56f47d1410fe with scrape type 1
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/1.jpg not downloaded yet
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/2.jpg not downloaded yet
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2ed50>
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/7.jpg saved to cache
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c35910>
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/5.jpg saved to cache
2026-03-27 16:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0d410>
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/8.jpg saved to cache
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692dff50>
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/10.jpg saved to cache
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d011d0>
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/9.jpg saved to cache
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/3.jpg not downloaded yet
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc3ed0>
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/1.jpg saved to cache
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc0fd0>
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/4.jpg saved to cache
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb7b10>
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/2.jpg saved to cache
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/4.jpg not downloaded yet
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/5.jpg not downloaded yet
2026-03-27 16:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/6.jpg not downloaded yet
2026-03-27 16:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/7.jpg not downloaded yet
2026-03-27 16:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/8.jpg not downloaded yet
2026-03-27 16:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/9.jpg not downloaded yet
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/10.jpg not downloaded yet
2026-03-27 16:34:59 [ayvens.it] INFO: Found listing with ID: 1988965
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988965%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [ayvens.it] INFO: Scrape type for 1988965: 1
2026-03-27 16:34:59 [ayvens.it] INFO: Extracting data for car ID: 1988965
2026-03-27 16:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c42a761d-f342-5525-82fc-f02240b53738 with identifier: 1988965
2026-03-27 16:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42a761d-f342-5525-82fc-f02240b53738 with scrape type 1
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/1.jpg not downloaded yet
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/2.jpg not downloaded yet
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd5bd0>
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/2.jpg saved to cache
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6902a0d0>
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/1.jpg saved to cache
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68533850>
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/10.jpg saved to cache
2026-03-27 16:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcee10>
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/6.jpg saved to cache
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694d95d0>
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/6.jpg saved to cache
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/3.jpg not downloaded yet
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c68d90>
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/3.jpg saved to cache
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ade61d0>
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/4.jpg saved to cache
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/4.jpg not downloaded yet
2026-03-27 16:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/5.jpg not downloaded yet
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69019210>
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/5.jpg saved to cache
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/6.jpg not downloaded yet
2026-03-27 16:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/7.jpg not downloaded yet
2026-03-27 16:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923f910>
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/4.jpg saved to cache
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d44450>
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/5.jpg saved to cache
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/8.jpg not downloaded yet
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/9.jpg not downloaded yet
2026-03-27 16:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/10.jpg not downloaded yet
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693412d0>
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/3.jpg saved to cache
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c10890>
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/6.jpg saved to cache
2026-03-27 16:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bdb450>
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/8.jpg saved to cache
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d23490>
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/9.jpg saved to cache
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912e4d0>
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F3bc00edcaa8046a58dfac6bf30319b27%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/7.jpg saved to cache
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a12546fb-f357-594e-bbea-faeef33b4a72
2026-03-27 16:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a12546fb-f357-594e-bbea-faeef33b4a72, skipping ID generation
2026-03-27 16:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a12546fb-f357-594e-bbea-faeef33b4a72 with scrape type 1
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a12546fb-f357-594e-bbea-faeef33b4a72 sending to next pipeline
2026-03-27 16:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a12546fb-f357-594e-bbea-faeef33b4a72, identifier: 1988962
2026-03-27 16:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a12546fb-f357-594e-bbea-faeef33b4a72 with identifier: 1988962
2026-03-27 16:35:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a12546fb-f357-594e-bbea-faeef33b4a72 with identifier: 1988962
2026-03-27 16:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a12546fb-f357-594e-bbea-faeef33b4a72 with identifier: 1988962 to the API
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SUPER RED',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'a12546fb-f357-594e-bbea-faeef33b4a72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP',
'odometer': 74503,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 760553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 751304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a12546fb-f357-594e-bbea-faeef33b4a72/a12546fb-f357-594e-bbea-faeef33b4a72_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/3bc00edcaa8046a58dfac6bf30319b27/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988962%27 HTTP/1.1" 200 None
2026-03-27 16:35:01 [ayvens.it] INFO: Saving data for 1988962: {'created_time': 1774629301.72501, 'last_price_update_time': 1774629301.725022, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988962') HTTP/1.1" 204 0
2026-03-27 16:35:01 [ayvens.it] INFO: Found listing with ID: 1988966
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988966%27 HTTP/1.1" 200 None
2026-03-27 16:35:01 [ayvens.it] INFO: Scrape type for 1988966: 1
2026-03-27 16:35:01 [ayvens.it] INFO: Extracting data for car ID: 1988966
2026-03-27 16:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a26fcbb3-eedb-5dad-919c-4fd9f89483bb with identifier: 1988966
2026-03-27 16:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb with scrape type 1
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/1.jpg not downloaded yet
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/2.jpg not downloaded yet
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6933a310>
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/3.jpg saved to cache
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/3.jpg not downloaded yet
2026-03-27 16:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/4.jpg not downloaded yet
2026-03-27 16:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/5.jpg not downloaded yet
2026-03-27 16:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/6.jpg not downloaded yet
2026-03-27 16:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/7.jpg not downloaded yet
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/8.jpg not downloaded yet
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f1710>
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/10.jpg saved to cache
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/9.jpg not downloaded yet
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af4a90>
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/4.jpg saved to cache
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68add810>
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/2.jpg saved to cache
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b64a90>
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/1.jpg saved to cache
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c7a450>
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/5.jpg saved to cache
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69419a90>
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/6.jpg saved to cache
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/10.jpg not downloaded yet
2026-03-27 16:35:02 [ayvens.it] INFO: Found listing with ID: 1988967
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988967%27 HTTP/1.1" 200 None
2026-03-27 16:35:02 [ayvens.it] INFO: Scrape type for 1988967: 1
2026-03-27 16:35:02 [ayvens.it] INFO: Extracting data for car ID: 1988967
2026-03-27 16:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da74ea51-0176-5a2f-856a-f1e8d069b2c3 with identifier: 1988967
2026-03-27 16:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da74ea51-0176-5a2f-856a-f1e8d069b2c3 with scrape type 1
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/1.jpg not downloaded yet
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd3b90>
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/3.jpg saved to cache
2026-03-27 16:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68546650>
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/2.jpg saved to cache
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/2.jpg not downloaded yet
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/3.jpg not downloaded yet
2026-03-27 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/4.jpg not downloaded yet
2026-03-27 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/5.jpg not downloaded yet
2026-03-27 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/6.jpg not downloaded yet
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/7.jpg not downloaded yet
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/8.jpg not downloaded yet
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/9.jpg not downloaded yet
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/10.jpg not downloaded yet
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff4050>
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/8.jpg saved to cache
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923fe90>
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/6.jpg saved to cache
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d229d0>
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/9.jpg saved to cache
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bee950>
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/10.jpg saved to cache
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:35:03 [ayvens.it] INFO: Found listing with ID: 1988968
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988968%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [ayvens.it] INFO: Scrape type for 1988968: 1
2026-03-27 16:35:03 [ayvens.it] INFO: Extracting data for car ID: 1988968
2026-03-27 16:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36747356-19a0-5d75-a491-806cf9043e91 with identifier: 1988968
2026-03-27 16:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36747356-19a0-5d75-a491-806cf9043e91 with scrape type 1
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/1.jpg not downloaded yet
2026-03-27 16:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bda990>
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/9.jpg saved to cache
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0d010>
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/1.jpg saved to cache
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/2.jpg not downloaded yet
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/3.jpg not downloaded yet
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f05cd0>
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/4.jpg saved to cache
2026-03-27 16:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6add56d0>
2026-03-27 16:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/5.jpg saved to cache
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c79f90>
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/4.jpg saved to cache
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/4.jpg not downloaded yet
2026-03-27 16:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/5.jpg not downloaded yet
2026-03-27 16:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/6.jpg not downloaded yet
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/7.jpg not downloaded yet
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/8.jpg not downloaded yet
2026-03-27 16:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/9.jpg not downloaded yet
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69324ad0>
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/3.jpg saved to cache
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/10.jpg not downloaded yet
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b00ad0>
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/9.jpg saved to cache
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc3d50>
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/1.jpg saved to cache
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:04 [ayvens.it] INFO: Found listing with ID: 1988969
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988969%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [ayvens.it] INFO: Scrape type for 1988969: 1
2026-03-27 16:35:04 [ayvens.it] INFO: Extracting data for car ID: 1988969
2026-03-27 16:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa633a22-c8dc-55ec-a76c-aacecfc041b3 with identifier: 1988969
2026-03-27 16:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa633a22-c8dc-55ec-a76c-aacecfc041b3 with scrape type 1
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/1.jpg not downloaded yet
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/2.jpg not downloaded yet
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c79b90>
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/5.jpg saved to cache
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69090a10>
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/10.jpg saved to cache
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69018bd0>
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/10.jpg saved to cache
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690935d0>
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/2.jpg saved to cache
2026-03-27 16:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b4b410>
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/3.jpg saved to cache
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/3.jpg not downloaded yet
2026-03-27 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/4.jpg not downloaded yet
2026-03-27 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/5.jpg not downloaded yet
2026-03-27 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/6.jpg not downloaded yet
2026-03-27 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/7.jpg not downloaded yet
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/8.jpg not downloaded yet
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/9.jpg not downloaded yet
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec3590>
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/7.jpg saved to cache
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad11b50>
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/8.jpg saved to cache
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bccf90>
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/10.jpg saved to cache
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/10.jpg not downloaded yet
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2290>
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/1.jpg saved to cache
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b308d0>
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/9.jpg saved to cache
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:05 [ayvens.it] INFO: Found listing with ID: 1988970
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988970%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [ayvens.it] INFO: Scrape type for 1988970: 1
2026-03-27 16:35:05 [ayvens.it] INFO: Extracting data for car ID: 1988970
2026-03-27 16:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af9b010d-6ec7-57e5-b350-364b31dca3be with identifier: 1988970
2026-03-27 16:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af9b010d-6ec7-57e5-b350-364b31dca3be with scrape type 1
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/1.jpg not downloaded yet
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/2.jpg not downloaded yet
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c993d0>
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/4.jpg saved to cache
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69009d90>
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/2.jpg saved to cache
2026-03-27 16:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c54d50>
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/1.jpg saved to cache
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:35:06 [scrapy.extensions.logstats] INFO: Crawled 15 pages (at 6 pages/min), scraped 114 items (at 38 items/min)
2026-03-27 16:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/3.jpg not downloaded yet
2026-03-27 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/4.jpg not downloaded yet
2026-03-27 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/5.jpg not downloaded yet
2026-03-27 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/6.jpg not downloaded yet
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/7.jpg not downloaded yet
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/8.jpg not downloaded yet
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/9.jpg not downloaded yet
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/10.jpg not downloaded yet
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925e810>
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/2.jpg saved to cache
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69236dd0>
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/8.jpg saved to cache
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b31590>
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/7.jpg saved to cache
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:06 [ayvens.it] INFO: Found listing with ID: 1988971
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988971%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [ayvens.it] INFO: Scrape type for 1988971: 1
2026-03-27 16:35:06 [ayvens.it] INFO: Extracting data for car ID: 1988971
2026-03-27 16:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a390e93-1fea-556d-b158-a059dae8ba68 with identifier: 1988971
2026-03-27 16:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a390e93-1fea-556d-b158-a059dae8ba68 with scrape type 1
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/1.jpg not downloaded yet
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef7810>
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/3.jpg saved to cache
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922f790>
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/6.jpg saved to cache
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b7d90>
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/4.jpg saved to cache
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922e810>
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/5.jpg saved to cache
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/2.jpg not downloaded yet
2026-03-27 16:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/3.jpg not downloaded yet
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d23e50>
2026-03-27 16:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/7.jpg saved to cache
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/4.jpg not downloaded yet
2026-03-27 16:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/5.jpg not downloaded yet
2026-03-27 16:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691cba90>
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/2.jpg saved to cache
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/6.jpg not downloaded yet
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/7.jpg not downloaded yet
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/8.jpg not downloaded yet
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b2be90>
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/1.jpg saved to cache
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934e050>
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/10.jpg saved to cache
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc0a90>
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/3.jpg saved to cache
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad13d10>
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/4.jpg saved to cache
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68accd90>
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/10.jpg saved to cache
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/9.jpg not downloaded yet
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/10.jpg not downloaded yet
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f98b50>
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/9.jpg saved to cache
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d343d0>
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/5.jpg saved to cache
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:35:07 [ayvens.it] INFO: Found listing with ID: 1988972
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988972%27 HTTP/1.1" 200 None
2026-03-27 16:35:07 [ayvens.it] INFO: Scrape type for 1988972: 1
2026-03-27 16:35:07 [ayvens.it] INFO: Extracting data for car ID: 1988972
2026-03-27 16:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58f27fd0-15f9-5ae6-94de-a911785b0086 with identifier: 1988972
2026-03-27 16:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f27fd0-15f9-5ae6-94de-a911785b0086 with scrape type 1
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/1.jpg not downloaded yet
2026-03-27 16:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/2.jpg not downloaded yet
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/3.jpg not downloaded yet
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/4.jpg not downloaded yet
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/5.jpg not downloaded yet
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/6.jpg not downloaded yet
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/7.jpg not downloaded yet
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccdf10>
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/1.jpg saved to cache
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/8.jpg not downloaded yet
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914e310>
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/3.jpg saved to cache
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f07b90>
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/2.jpg saved to cache
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfc8d0>
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/10.jpg saved to cache
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c68290>
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/7.jpg saved to cache
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/9.jpg not downloaded yet
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/10.jpg not downloaded yet
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69516f50>
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/9.jpg saved to cache
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934fc50>
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/8.jpg saved to cache
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [ayvens.it] INFO: Found listing with ID: 1988973
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988973%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [ayvens.it] INFO: Scrape type for 1988973: 1
2026-03-27 16:35:08 [ayvens.it] INFO: Extracting data for car ID: 1988973
2026-03-27 16:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af916d5-4b18-50e3-a3b9-665f86c8faff with identifier: 1988973
2026-03-27 16:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af916d5-4b18-50e3-a3b9-665f86c8faff with scrape type 1
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/1.jpg not downloaded yet
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/2.jpg not downloaded yet
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/3.jpg not downloaded yet
2026-03-27 16:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/4.jpg not downloaded yet
2026-03-27 16:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/5.jpg not downloaded yet
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb4a50>
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/1.jpg saved to cache
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/6.jpg not downloaded yet
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/7.jpg not downloaded yet
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/8.jpg not downloaded yet
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69008710>
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/2.jpg saved to cache
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b5ad0>
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/3.jpg saved to cache
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68517650>
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/6.jpg saved to cache
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf6090>
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/4.jpg saved to cache
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69162f50>
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/4.jpg saved to cache
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5de10>
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F849981122755490483f8f31c94e3b8f7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/5.jpg saved to cache
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af9b010d-6ec7-57e5-b350-364b31dca3be
2026-03-27 16:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af9b010d-6ec7-57e5-b350-364b31dca3be, skipping ID generation
2026-03-27 16:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af9b010d-6ec7-57e5-b350-364b31dca3be with scrape type 1
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af9b010d-6ec7-57e5-b350-364b31dca3be sending to next pipeline
2026-03-27 16:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af9b010d-6ec7-57e5-b350-364b31dca3be, identifier: 1988970
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb0210>
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/5.jpg saved to cache
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af9b010d-6ec7-57e5-b350-364b31dca3be with identifier: 1988970
2026-03-27 16:35:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af9b010d-6ec7-57e5-b350-364b31dca3be with identifier: 1988970
2026-03-27 16:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af9b010d-6ec7-57e5-b350-364b31dca3be with identifier: 1988970 to the API
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SOLAR SILVER METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'af9b010d-6ec7-57e5-b350-364b31dca3be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 29700,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 58,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 708127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 789934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 708127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 653331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594819,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645124,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af9b010d-6ec7-57e5-b350-364b31dca3be/af9b010d-6ec7-57e5-b350-364b31dca3be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543443,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/849981122755490483f8f31c94e3b8f7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988970%27 HTTP/1.1" 200 None
2026-03-27 16:35:10 [ayvens.it] INFO: Saving data for 1988970: {'created_time': 1774629310.742875, 'last_price_update_time': 1774629310.742884, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988970') HTTP/1.1" 204 0
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/9.jpg not downloaded yet
2026-03-27 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/10.jpg not downloaded yet
2026-03-27 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:10 [ayvens.it] INFO: Found listing with ID: 1988974
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988974%27 HTTP/1.1" 200 None
2026-03-27 16:35:10 [ayvens.it] INFO: Scrape type for 1988974: 1
2026-03-27 16:35:10 [ayvens.it] INFO: Extracting data for car ID: 1988974
2026-03-27 16:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a540c7-8622-5a45-a942-469ec9a5bcef with identifier: 1988974
2026-03-27 16:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a540c7-8622-5a45-a942-469ec9a5bcef with scrape type 1
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/1.jpg not downloaded yet
2026-03-27 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/2.jpg not downloaded yet
2026-03-27 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/3.jpg not downloaded yet
2026-03-27 16:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/4.jpg not downloaded yet
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/5.jpg not downloaded yet
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c12f10>
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/10.jpg saved to cache
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/6.jpg not downloaded yet
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691629d0>
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/8.jpg saved to cache
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/7.jpg not downloaded yet
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c49a50>
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/9.jpg saved to cache
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69326010>
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/7.jpg saved to cache
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7ef90>
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/9.jpg saved to cache
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69162f50>
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/8.jpg saved to cache
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4b790>
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/1.jpg saved to cache
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b54d50>
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/2.jpg saved to cache
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/8.jpg not downloaded yet
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/9.jpg not downloaded yet
2026-03-27 16:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/10.jpg not downloaded yet
2026-03-27 16:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:11 [ayvens.it] INFO: Found listing with ID: 1988975
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988975%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [ayvens.it] INFO: Scrape type for 1988975: 1
2026-03-27 16:35:11 [ayvens.it] INFO: Extracting data for car ID: 1988975
2026-03-27 16:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1 with identifier: 1988975
2026-03-27 16:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1 with scrape type 1
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/1.jpg not downloaded yet
2026-03-27 16:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/2.jpg not downloaded yet
2026-03-27 16:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/3.jpg not downloaded yet
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/4.jpg not downloaded yet
2026-03-27 16:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/5.jpg not downloaded yet
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0e150>
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/10.jpg saved to cache
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6af01dd0>
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/6.jpg saved to cache
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/6.jpg not downloaded yet
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6adc3b10>
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/9.jpg saved to cache
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5b390>
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/8.jpg saved to cache
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912ebd0>
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/9.jpg saved to cache
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/7.jpg not downloaded yet
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ace5d0>
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/1.jpg saved to cache
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6902a3d0>
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/5.jpg saved to cache
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68547490>
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/2.jpg saved to cache
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/8.jpg not downloaded yet
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/9.jpg not downloaded yet
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/10.jpg not downloaded yet
2026-03-27 16:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:12 [ayvens.it] INFO: Found listing with ID: 1988976
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988976%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [ayvens.it] INFO: Scrape type for 1988976: 1
2026-03-27 16:35:12 [ayvens.it] INFO: Extracting data for car ID: 1988976
2026-03-27 16:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843 with identifier: 1988976
2026-03-27 16:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843 with scrape type 1
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/1.jpg not downloaded yet
2026-03-27 16:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/2.jpg not downloaded yet
2026-03-27 16:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/3.jpg not downloaded yet
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/4.jpg not downloaded yet
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/5.jpg not downloaded yet
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b1bf90>
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/4.jpg saved to cache
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc9c90>
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/6.jpg saved to cache
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/6.jpg not downloaded yet
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/7.jpg not downloaded yet
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/8.jpg not downloaded yet
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b2b190>
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/10.jpg saved to cache
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68608a10>
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/5.jpg saved to cache
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6adc3690>
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/1.jpg saved to cache
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b7e10>
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/4.jpg saved to cache
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cded50>
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/5.jpg saved to cache
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/9.jpg not downloaded yet
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/10.jpg not downloaded yet
2026-03-27 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:13 [ayvens.it] INFO: Found listing with ID: 1988977
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988977%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [ayvens.it] INFO: Scrape type for 1988977: 1
2026-03-27 16:35:13 [ayvens.it] INFO: Extracting data for car ID: 1988977
2026-03-27 16:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e488e3c9-60c0-5953-826e-2854ea2e6cb1 with identifier: 1988977
2026-03-27 16:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e488e3c9-60c0-5953-826e-2854ea2e6cb1 with scrape type 1
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/1.jpg not downloaded yet
2026-03-27 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/2.jpg not downloaded yet
2026-03-27 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/3.jpg not downloaded yet
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/4.jpg not downloaded yet
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/5.jpg not downloaded yet
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69327050>
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/9.jpg saved to cache
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feb2d0>
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/8.jpg saved to cache
2026-03-27 16:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c10710>
2026-03-27 16:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/7.jpg saved to cache
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/6.jpg not downloaded yet
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/7.jpg not downloaded yet
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/8.jpg not downloaded yet
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69236e50>
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/10.jpg saved to cache
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b9f50>
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/1.jpg saved to cache
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d36850>
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/6.jpg saved to cache
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b575d0>
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/3.jpg saved to cache
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69355d50>
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/7.jpg saved to cache
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/9.jpg not downloaded yet
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/10.jpg not downloaded yet
2026-03-27 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:14 [ayvens.it] INFO: Found listing with ID: 1988978
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988978%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [ayvens.it] INFO: Scrape type for 1988978: 1
2026-03-27 16:35:15 [ayvens.it] INFO: Extracting data for car ID: 1988978
2026-03-27 16:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96fc3907-28cd-5237-9d60-20203660740f with identifier: 1988978
2026-03-27 16:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96fc3907-28cd-5237-9d60-20203660740f with scrape type 1
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/1.jpg not downloaded yet
2026-03-27 16:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/2.jpg not downloaded yet
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/3.jpg not downloaded yet
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/4.jpg not downloaded yet
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/5.jpg not downloaded yet
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/6.jpg not downloaded yet
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6901a650>
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/5.jpg saved to cache
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b557d0>
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/10.jpg saved to cache
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb4c90>
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/4.jpg saved to cache
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad12ed0>
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/6.jpg saved to cache
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb6ad0>
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/3.jpg saved to cache
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecc410>
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/5.jpg saved to cache
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb4310>
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/8.jpg saved to cache
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/7.jpg not downloaded yet
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/8.jpg not downloaded yet
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/9.jpg not downloaded yet
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6941b390>
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/9.jpg saved to cache
2026-03-27 16:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/10.jpg not downloaded yet
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [ayvens.it] INFO: Found listing with ID: 1988979
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988979%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [ayvens.it] INFO: Scrape type for 1988979: 1
2026-03-27 16:35:16 [ayvens.it] INFO: Extracting data for car ID: 1988979
2026-03-27 16:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7 with identifier: 1988979
2026-03-27 16:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7 with scrape type 1
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/1.jpg not downloaded yet
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/2.jpg not downloaded yet
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/3.jpg not downloaded yet
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/4.jpg not downloaded yet
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fad590>
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/6.jpg saved to cache
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/5.jpg not downloaded yet
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ae8290>
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/1.jpg saved to cache
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68faffd0>
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/5.jpg saved to cache
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68516550>
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/9.jpg saved to cache
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5dc90>
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/10.jpg saved to cache
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/6.jpg not downloaded yet
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/7.jpg not downloaded yet
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5d950>
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/2.jpg saved to cache
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f5050>
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/8.jpg saved to cache
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f98450>
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/7.jpg saved to cache
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/8.jpg not downloaded yet
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/9.jpg not downloaded yet
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c56bd0>
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/10.jpg saved to cache
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/10.jpg not downloaded yet
2026-03-27 16:35:16 [ayvens.it] INFO: Found listing with ID: 1988980
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988980%27 HTTP/1.1" 200 None
2026-03-27 16:35:17 [ayvens.it] INFO: Scrape type for 1988980: 1
2026-03-27 16:35:17 [ayvens.it] INFO: Extracting data for car ID: 1988980
2026-03-27 16:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c2898b2-3b94-54a4-95d5-e97ea3cb339f with identifier: 1988980
2026-03-27 16:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f with scrape type 1
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/1.jpg not downloaded yet
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/2.jpg not downloaded yet
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1fcd0>
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/9.jpg saved to cache
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835d590>
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/4.jpg saved to cache
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f06d0>
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/3.jpg saved to cache
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835fdd0>
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/7.jpg saved to cache
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/3.jpg not downloaded yet
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec0050>
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/8.jpg saved to cache
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692fb290>
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh2%252F65e1e07d103c43818ab6bd50be245d16%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/2.jpg saved to cache
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e488e3c9-60c0-5953-826e-2854ea2e6cb1
2026-03-27 16:35:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e488e3c9-60c0-5953-826e-2854ea2e6cb1, skipping ID generation
2026-03-27 16:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e488e3c9-60c0-5953-826e-2854ea2e6cb1 with scrape type 1
2026-03-27 16:35:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e488e3c9-60c0-5953-826e-2854ea2e6cb1 sending to next pipeline
2026-03-27 16:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e488e3c9-60c0-5953-826e-2854ea2e6cb1, identifier: 1988977
2026-03-27 16:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e488e3c9-60c0-5953-826e-2854ea2e6cb1 with identifier: 1988977
2026-03-27 16:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e488e3c9-60c0-5953-826e-2854ea2e6cb1 with identifier: 1988977
2026-03-27 16:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e488e3c9-60c0-5953-826e-2854ea2e6cb1 with identifier: 1988977 to the API
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'electric',
'id': 'e488e3c9-60c0-5953-826e-2854ea2e6cb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C4 100 KW 136CV ELECTRIC SHINE',
'odometer': 33118,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569622,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467676,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550524,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e488e3c9-60c0-5953-826e-2854ea2e6cb1/e488e3c9-60c0-5953-826e-2854ea2e6cb1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh2/65e1e07d103c43818ab6bd50be245d16/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C4 100 KW 136CV ELECTRIC SHINE -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988977%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [ayvens.it] INFO: Saving data for 1988977: {'created_time': 1774629318.408384, 'last_price_update_time': 1774629318.408396, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988977') HTTP/1.1" 204 0
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/4.jpg not downloaded yet
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68454bd0>
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/7.jpg saved to cache
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/5.jpg not downloaded yet
2026-03-27 16:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/6.jpg not downloaded yet
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/7.jpg not downloaded yet
2026-03-27 16:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/8.jpg not downloaded yet
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/9.jpg not downloaded yet
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/10.jpg not downloaded yet
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fee290>
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/9.jpg saved to cache
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:18 [ayvens.it] INFO: Found listing with ID: 1988981
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988981%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [ayvens.it] INFO: Scrape type for 1988981: 1
2026-03-27 16:35:18 [ayvens.it] INFO: Extracting data for car ID: 1988981
2026-03-27 16:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87ef6e0d-6c29-512b-a8a4-87e3957e5f70 with identifier: 1988981
2026-03-27 16:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70 with scrape type 1
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/1.jpg not downloaded yet
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69143d10>
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/8.jpg saved to cache
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c6110>
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/6.jpg saved to cache
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/2.jpg not downloaded yet
2026-03-27 16:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/3.jpg not downloaded yet
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef4550>
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/3.jpg saved to cache
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68521450>
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/4.jpg saved to cache
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c68890>
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/5.jpg saved to cache
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef7d50>
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/2.jpg saved to cache
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad13a90>
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/10.jpg saved to cache
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/4.jpg not downloaded yet
2026-03-27 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/5.jpg not downloaded yet
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d34f90>
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/8.jpg saved to cache
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/6.jpg not downloaded yet
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/7.jpg not downloaded yet
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/8.jpg not downloaded yet
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f8310>
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/5.jpg saved to cache
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba15d0>
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/4.jpg saved to cache
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914e5d0>
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/6.jpg saved to cache
2026-03-27 16:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6860b050>
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/7.jpg saved to cache
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914d610>
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/9.jpg saved to cache
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914da50>
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/2.jpg saved to cache
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690906d0>
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/3.jpg saved to cache
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/9.jpg not downloaded yet
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/10.jpg not downloaded yet
2026-03-27 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:20 [ayvens.it] INFO: Found listing with ID: 1988982
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988982%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [ayvens.it] INFO: Scrape type for 1988982: 1
2026-03-27 16:35:20 [ayvens.it] INFO: Extracting data for car ID: 1988982
2026-03-27 16:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46dcf41d-ce60-54eb-8feb-c51c1493aedd with identifier: 1988982
2026-03-27 16:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd with scrape type 1
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/1.jpg not downloaded yet
2026-03-27 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/2.jpg not downloaded yet
2026-03-27 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/3.jpg not downloaded yet
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/4.jpg not downloaded yet
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/5.jpg not downloaded yet
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb5cd0>
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/10.jpg saved to cache
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/6.jpg not downloaded yet
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/7.jpg not downloaded yet
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/8.jpg not downloaded yet
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad12e90>
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/4.jpg saved to cache
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934ea50>
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/3.jpg saved to cache
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69341ed0>
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn8%252Ffd2b08fddbad41739a1362314ada81b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/1.jpg saved to cache
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7
2026-03-27 16:35:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7, skipping ID generation
2026-03-27 16:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7 with scrape type 1
2026-03-27 16:35:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7 sending to next pipeline
2026-03-27 16:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7, identifier: 1988979
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690f1150>
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/5.jpg saved to cache
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcf750>
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/6.jpg saved to cache
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d23ad0>
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/1.jpg saved to cache
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69325b50>
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/2.jpg saved to cache
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7 with identifier: 1988979
2026-03-27 16:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7 with identifier: 1988979
2026-03-27 16:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7 with identifier: 1988979 to the API
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GENERIC COLOR',
'currency': 'EUR',
'doors_number': 3,
'engine': '2.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT MASTER FG TA L2 H2 T33 ENERGY DCI 150 ADVANCE',
'odometer': 58170,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533893,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533893,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525545,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490086,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7/1bfa8d3c-85ae-51c6-bc3d-a2e37c1b75a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn8/fd2b08fddbad41739a1362314ada81b1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT MASTER FG TA L2 H2 T33 ENERGY DCI 150 ADVANCE -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988979%27 HTTP/1.1" 200 None
2026-03-27 16:35:21 [ayvens.it] INFO: Saving data for 1988979: {'created_time': 1774629321.914329, 'last_price_update_time': 1774629321.914339, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988979') HTTP/1.1" 204 0
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/9.jpg not downloaded yet
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/10.jpg not downloaded yet
2026-03-27 16:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:21 [ayvens.it] INFO: Found listing with ID: 1988983
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988983%27 HTTP/1.1" 200 None
2026-03-27 16:35:22 [ayvens.it] INFO: Scrape type for 1988983: 1
2026-03-27 16:35:22 [ayvens.it] INFO: Extracting data for car ID: 1988983
2026-03-27 16:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e28600-fce2-5823-8f2a-e38004027a18 with identifier: 1988983
2026-03-27 16:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e28600-fce2-5823-8f2a-e38004027a18 with scrape type 1
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/1.jpg not downloaded yet
2026-03-27 16:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/2.jpg not downloaded yet
2026-03-27 16:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/3.jpg not downloaded yet
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/4.jpg not downloaded yet
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/5.jpg not downloaded yet
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694db810>
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/2.jpg saved to cache
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912fb10>
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/10.jpg saved to cache
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccee50>
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/1.jpg saved to cache
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/6.jpg not downloaded yet
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/7.jpg not downloaded yet
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/8.jpg not downloaded yet
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c7590>
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/7.jpg saved to cache
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcb650>
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/3.jpg saved to cache
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923d0d0>
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/9.jpg saved to cache
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8ee10>
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl6%252F6092ba2334014d5c99d967c611370b8c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/8.jpg saved to cache
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f
2026-03-27 16:35:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c2898b2-3b94-54a4-95d5-e97ea3cb339f, skipping ID generation
2026-03-27 16:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f with scrape type 1
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c2898b2-3b94-54a4-95d5-e97ea3cb339f sending to next pipeline
2026-03-27 16:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2c2898b2-3b94-54a4-95d5-e97ea3cb339f, identifier: 1988980
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca2a90>
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/4.jpg saved to cache
2026-03-27 16:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2c2898b2-3b94-54a4-95d5-e97ea3cb339f with identifier: 1988980
2026-03-27 16:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2c2898b2-3b94-54a4-95d5-e97ea3cb339f with identifier: 1988980
2026-03-27 16:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2c2898b2-3b94-54a4-95d5-e97ea3cb339f with identifier: 1988980 to the API
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROYAL BLUE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '2c2898b2-3b94-54a4-95d5-e97ea3cb339f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CORSA 1.2 Advance 70cv Hatchback 5-door',
'odometer': 123306,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660086,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507594,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2898b2-3b94-54a4-95d5-e97ea3cb339f/2c2898b2-3b94-54a4-95d5-e97ea3cb339f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540141,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl6/6092ba2334014d5c99d967c611370b8c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CORSA 1.2 Advance 70cv Hatchback 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988980%27 HTTP/1.1" 200 None
2026-03-27 16:35:23 [ayvens.it] INFO: Saving data for 1988980: {'created_time': 1774629323.450459, 'last_price_update_time': 1774629323.450469, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988980') HTTP/1.1" 204 0
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/9.jpg not downloaded yet
2026-03-27 16:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/10.jpg not downloaded yet
2026-03-27 16:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1c210>
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/10.jpg saved to cache
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:23 [ayvens.it] INFO: Found listing with ID: 1988984
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988984%27 HTTP/1.1" 200 None
2026-03-27 16:35:23 [ayvens.it] INFO: Scrape type for 1988984: 1
2026-03-27 16:35:23 [ayvens.it] INFO: Extracting data for car ID: 1988984
2026-03-27 16:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09ec88cd-4db4-50af-b5c4-9a4681354f66 with identifier: 1988984
2026-03-27 16:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ec88cd-4db4-50af-b5c4-9a4681354f66 with scrape type 1
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/1.jpg not downloaded yet
2026-03-27 16:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/2.jpg not downloaded yet
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b1d0290>
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/1.jpg saved to cache
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5a650>
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/9.jpg saved to cache
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/3.jpg not downloaded yet
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fada90>
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/8.jpg saved to cache
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fadad0>
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/6.jpg saved to cache
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/4.jpg not downloaded yet
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c0af10>
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/7.jpg saved to cache
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c08450>
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/5.jpg saved to cache
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d02490>
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/6.jpg saved to cache
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/5.jpg not downloaded yet
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/6.jpg not downloaded yet
2026-03-27 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/7.jpg not downloaded yet
2026-03-27 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/8.jpg not downloaded yet
2026-03-27 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/9.jpg not downloaded yet
2026-03-27 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/10.jpg not downloaded yet
2026-03-27 16:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:24 [ayvens.it] INFO: Found listing with ID: 1988985
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988985%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [ayvens.it] INFO: Scrape type for 1988985: 1
2026-03-27 16:35:24 [ayvens.it] INFO: Extracting data for car ID: 1988985
2026-03-27 16:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c192dcee-99b7-5af9-b776-676ef7c1ad95 with identifier: 1988985
2026-03-27 16:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c192dcee-99b7-5af9-b776-676ef7c1ad95 with scrape type 1
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/1.jpg not downloaded yet
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/2.jpg not downloaded yet
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fae690>
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/9.jpg saved to cache
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922c390>
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/8.jpg saved to cache
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69343850>
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/7.jpg saved to cache
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690188d0>
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/10.jpg saved to cache
2026-03-27 16:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69341f90>
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/1.jpg saved to cache
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922ced0>
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/4.jpg saved to cache
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/3.jpg not downloaded yet
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3cfd0>
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/6.jpg saved to cache
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bd9f50>
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/5.jpg saved to cache
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/4.jpg not downloaded yet
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/5.jpg not downloaded yet
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/6.jpg not downloaded yet
2026-03-27 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/7.jpg not downloaded yet
2026-03-27 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/8.jpg not downloaded yet
2026-03-27 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/9.jpg not downloaded yet
2026-03-27 16:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/10.jpg not downloaded yet
2026-03-27 16:35:25 [ayvens.it] INFO: Found listing with ID: 1988986
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988986%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [ayvens.it] INFO: Scrape type for 1988986: 1
2026-03-27 16:35:25 [ayvens.it] INFO: Extracting data for car ID: 1988986
2026-03-27 16:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21faf328-af9b-58aa-9903-328fe045615b with identifier: 1988986
2026-03-27 16:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21faf328-af9b-58aa-9903-328fe045615b with scrape type 1
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F1.jpeg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/1.jpeg not downloaded yet
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/2.jpg not downloaded yet
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685460d0>
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/1.jpg saved to cache
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b7e90>
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/10.jpg saved to cache
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0c190>
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/8.jpg saved to cache
2026-03-27 16:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d11f90>
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/9.jpg saved to cache
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b02250>
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/4.jpg saved to cache
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bda8d0>
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/3.jpg saved to cache
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acfb50>
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/7.jpg saved to cache
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad13f90>
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm3%252F064620b1c4e2448d902c815cc2dcb429%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/2.jpg saved to cache
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99e28600-fce2-5823-8f2a-e38004027a18
2026-03-27 16:35:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99e28600-fce2-5823-8f2a-e38004027a18, skipping ID generation
2026-03-27 16:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e28600-fce2-5823-8f2a-e38004027a18 with scrape type 1
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99e28600-fce2-5823-8f2a-e38004027a18 sending to next pipeline
2026-03-27 16:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 99e28600-fce2-5823-8f2a-e38004027a18, identifier: 1988983
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/3.jpg not downloaded yet
2026-03-27 16:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 99e28600-fce2-5823-8f2a-e38004027a18 with identifier: 1988983
2026-03-27 16:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 99e28600-fce2-5823-8f2a-e38004027a18 with identifier: 1988983
2026-03-27 16:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 99e28600-fce2-5823-8f2a-e38004027a18 with identifier: 1988983 to the API
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol_lpg',
'id': '99e28600-fce2-5823-8f2a-e38004027a18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP12 1.2 69CV EASYPOWER E6 EASY FP',
'odometer': 65173,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 822428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 822428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827867,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 798463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809749,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718914,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 789122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 753574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99e28600-fce2-5823-8f2a-e38004027a18/99e28600-fce2-5823-8f2a-e38004027a18_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm3/064620b1c4e2448d902c815cc2dcb429/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP12 1.2 69CV EASYPOWER E6 EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988983%27 HTTP/1.1" 200 None
2026-03-27 16:35:26 [ayvens.it] INFO: Saving data for 1988983: {'created_time': 1774629326.921797, 'last_price_update_time': 1774629326.921808, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988983') HTTP/1.1" 204 0
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/4.jpg not downloaded yet
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/5.jpg not downloaded yet
2026-03-27 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/6.jpg not downloaded yet
2026-03-27 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/7.jpg not downloaded yet
2026-03-27 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/8.jpg not downloaded yet
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/9.jpg not downloaded yet
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/10.jpg not downloaded yet
2026-03-27 16:35:27 [ayvens.it] INFO: Found listing with ID: 1988987
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988987%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [ayvens.it] INFO: Scrape type for 1988987: 1
2026-03-27 16:35:27 [ayvens.it] INFO: Extracting data for car ID: 1988987
2026-03-27 16:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee with identifier: 1988987
2026-03-27 16:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee with scrape type 1
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/1.jpg not downloaded yet
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/2.jpg not downloaded yet
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b01b90>
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/6.jpg saved to cache
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69090150>
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/7.jpg saved to cache
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b4fd0>
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/5.jpg saved to cache
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68540ad0>
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/4.jpg saved to cache
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69091b90>
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/3.jpg saved to cache
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba2290>
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/2.jpg saved to cache
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bdb890>
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/8.jpg saved to cache
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/3.jpg not downloaded yet
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68954e90>
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/3.jpg saved to cache
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/4.jpg not downloaded yet
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/5.jpg not downloaded yet
2026-03-27 16:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/6.jpg not downloaded yet
2026-03-27 16:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/7.jpg not downloaded yet
2026-03-27 16:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/1.jpeg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/8.jpg not downloaded yet
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/9.jpg not downloaded yet
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/10.jpg not downloaded yet
2026-03-27 16:35:28 [ayvens.it] INFO: Found listing with ID: 1988988
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988988%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [ayvens.it] INFO: Scrape type for 1988988: 1
2026-03-27 16:35:28 [ayvens.it] INFO: Extracting data for car ID: 1988988
2026-03-27 16:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0 with identifier: 1988988
2026-03-27 16:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0 with scrape type 1
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/1.jpg not downloaded yet
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c11890>
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/6.jpg saved to cache
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/2.jpg not downloaded yet
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b710d0>
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/10.jpg saved to cache
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690908d0>
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/5.jpg saved to cache
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692fbb10>
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/2.jpg saved to cache
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692fa810>
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/4.jpg saved to cache
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad11890>
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/1.jpg saved to cache
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c9a310>
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F1.jpeg') HTTP/1.1" 204 0
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/1.jpeg saved to cache
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef6310>
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/3.jpg saved to cache
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/3.jpg not downloaded yet
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/4.jpg not downloaded yet
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/5.jpg not downloaded yet
2026-03-27 16:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/6.jpg not downloaded yet
2026-03-27 16:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/7.jpg not downloaded yet
2026-03-27 16:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/8.jpg not downloaded yet
2026-03-27 16:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/9.jpg not downloaded yet
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/10.jpg not downloaded yet
2026-03-27 16:35:29 [ayvens.it] INFO: Found listing with ID: 1988989
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988989%27 HTTP/1.1" 200 None
2026-03-27 16:35:29 [ayvens.it] INFO: Scrape type for 1988989: 1
2026-03-27 16:35:29 [ayvens.it] INFO: Extracting data for car ID: 1988989
2026-03-27 16:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3748ba7-94b1-5a31-b860-85acd408a814 with identifier: 1988989
2026-03-27 16:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3748ba7-94b1-5a31-b860-85acd408a814 with scrape type 1
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/1.jpg not downloaded yet
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/2.jpg not downloaded yet
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934fd10>
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/7.jpg saved to cache
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916de90>
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/6.jpg saved to cache
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff7850>
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/4.jpg saved to cache
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4be50>
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/5.jpg saved to cache
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7d910>
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/3.jpg saved to cache
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934fad0>
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/9.jpg saved to cache
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/3.jpg not downloaded yet
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6902b010>
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/2.jpg saved to cache
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69029190>
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk5%252F3d3efb5259d74ff49f159d96f5b3c9f0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/8.jpg saved to cache
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c192dcee-99b7-5af9-b776-676ef7c1ad95
2026-03-27 16:35:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c192dcee-99b7-5af9-b776-676ef7c1ad95, skipping ID generation
2026-03-27 16:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c192dcee-99b7-5af9-b776-676ef7c1ad95 with scrape type 1
2026-03-27 16:35:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c192dcee-99b7-5af9-b776-676ef7c1ad95 sending to next pipeline
2026-03-27 16:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c192dcee-99b7-5af9-b776-676ef7c1ad95, identifier: 1988985
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/4.jpg not downloaded yet
2026-03-27 16:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c192dcee-99b7-5af9-b776-676ef7c1ad95 with identifier: 1988985
2026-03-27 16:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c192dcee-99b7-5af9-b776-676ef7c1ad95 with identifier: 1988985
2026-03-27 16:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c192dcee-99b7-5af9-b776-676ef7c1ad95 with identifier: 1988985 to the API
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'c192dcee-99b7-5af9-b776-676ef7c1ad95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO COMBI 1.3 Mjet 16v 95CV SX (cat. N1) Eu6 Combi '
'5-door',
'odometer': 72463,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709605,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570839,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c192dcee-99b7-5af9-b776-676ef7c1ad95/c192dcee-99b7-5af9-b776-676ef7c1ad95_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595400,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk5/3d3efb5259d74ff49f159d96f5b3c9f0/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-14',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO COMBI 1.3 Mjet 16v 95CV SX (cat. N1) Eu6 '
'Combi 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988985%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [ayvens.it] INFO: Saving data for 1988985: {'created_time': 1774629330.469364, 'last_price_update_time': 1774629330.469374, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988985') HTTP/1.1" 204 0
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/5.jpg not downloaded yet
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/6.jpg not downloaded yet
2026-03-27 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/7.jpg not downloaded yet
2026-03-27 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/8.jpg not downloaded yet
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/9.jpg not downloaded yet
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/10.jpg not downloaded yet
2026-03-27 16:35:30 [ayvens.it] INFO: Found listing with ID: 1988990
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988990%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [ayvens.it] INFO: Scrape type for 1988990: 1
2026-03-27 16:35:30 [ayvens.it] INFO: Extracting data for car ID: 1988990
2026-03-27 16:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770bea77-eeca-5623-a99f-0477f5713f35 with identifier: 1988990
2026-03-27 16:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770bea77-eeca-5623-a99f-0477f5713f35 with scrape type 1
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/1.jpg not downloaded yet
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/2.jpg not downloaded yet
2026-03-27 16:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b80e10>
2026-03-27 16:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/6.jpg saved to cache
2026-03-27 16:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685096d0>
2026-03-27 16:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/1.jpg saved to cache
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912ee50>
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/2.jpg saved to cache
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fca4d0>
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/10.jpg saved to cache
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912ed50>
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/5.jpg saved to cache
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c20050>
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/9.jpg saved to cache
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912de50>
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/4.jpg saved to cache
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcbb90>
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/1.jpg saved to cache
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/3.jpg not downloaded yet
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/4.jpg not downloaded yet
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/5.jpg not downloaded yet
2026-03-27 16:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/6.jpg not downloaded yet
2026-03-27 16:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/7.jpg not downloaded yet
2026-03-27 16:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/8.jpg not downloaded yet
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/9.jpg not downloaded yet
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/10.jpg not downloaded yet
2026-03-27 16:35:31 [ayvens.it] INFO: Found listing with ID: 1988991
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988991%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [ayvens.it] INFO: Scrape type for 1988991: 1
2026-03-27 16:35:31 [ayvens.it] INFO: Extracting data for car ID: 1988991
2026-03-27 16:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6081d2f1-948b-59ab-a893-672bf785d5ee with identifier: 1988991
2026-03-27 16:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6081d2f1-948b-59ab-a893-672bf785d5ee with scrape type 1
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/1.jpg not downloaded yet
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/2.jpg not downloaded yet
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b024d0>
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/6.jpg saved to cache
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d365d0>
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/5.jpg saved to cache
2026-03-27 16:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ece650>
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/3.jpg saved to cache
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cde350>
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/4.jpg saved to cache
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecdf50>
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/3.jpg saved to cache
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e4b10>
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/8.jpg saved to cache
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d36790>
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj5%252F41e0c2806b0045ef96b21bd979f0096a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/7.jpg saved to cache
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee
2026-03-27 16:35:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee, skipping ID generation
2026-03-27 16:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee with scrape type 1
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee sending to next pipeline
2026-03-27 16:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee, identifier: 1988987
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bce5d0>
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/2.jpg saved to cache
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/3.jpg not downloaded yet
2026-03-27 16:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee with identifier: 1988987
2026-03-27 16:35:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee with identifier: 1988987
2026-03-27 16:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee with identifier: 1988987 to the API
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FUJI WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'd93f52ac-5cdc-5794-aa8d-1c1fe0f301ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 2.0 TD4 180CV BUSINESS EDITION SE AUTO',
'odometer': 83693,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755273,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 722684,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563981,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee/d93f52ac-5cdc-5794-aa8d-1c1fe0f301ee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj5/41e0c2806b0045ef96b21bd979f0096a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 2.0 TD4 180CV BUSINESS '
'EDITION SE AUTO -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988987%27 HTTP/1.1" 200 None
2026-03-27 16:35:32 [ayvens.it] INFO: Saving data for 1988987: {'created_time': 1774629332.967011, 'last_price_update_time': 1774629332.967024, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988987') HTTP/1.1" 204 0
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/4.jpg not downloaded yet
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/5.jpg not downloaded yet
2026-03-27 16:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/6.jpg not downloaded yet
2026-03-27 16:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/7.jpg not downloaded yet
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/8.jpg not downloaded yet
2026-03-27 16:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/9.jpg not downloaded yet
2026-03-27 16:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/10.jpg not downloaded yet
2026-03-27 16:35:33 [ayvens.it] INFO: Found listing with ID: 1988992
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988992%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [ayvens.it] INFO: Scrape type for 1988992: 1
2026-03-27 16:35:33 [ayvens.it] INFO: Extracting data for car ID: 1988992
2026-03-27 16:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a13099a7-a715-5c90-a22f-89fb0d1d952b with identifier: 1988992
2026-03-27 16:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a13099a7-a715-5c90-a22f-89fb0d1d952b with scrape type 1
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/1.jpg not downloaded yet
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69091490>
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/1.jpg saved to cache
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/2.jpg not downloaded yet
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb02d0>
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/6.jpg saved to cache
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af5410>
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/10.jpg saved to cache
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8ef90>
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/5.jpg saved to cache
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1d810>
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/4.jpg saved to cache
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/3.jpg not downloaded yet
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/4.jpg not downloaded yet
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692faf90>
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/2.jpg saved to cache
2026-03-27 16:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68515410>
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/3.jpg saved to cache
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef7650>
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/1.jpg saved to cache
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/5.jpg not downloaded yet
2026-03-27 16:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/6.jpg not downloaded yet
2026-03-27 16:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/7.jpg not downloaded yet
2026-03-27 16:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/8.jpg not downloaded yet
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/9.jpg not downloaded yet
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/10.jpg not downloaded yet
2026-03-27 16:35:34 [ayvens.it] INFO: Found listing with ID: 1988993
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988993%27 HTTP/1.1" 200 None
2026-03-27 16:35:34 [ayvens.it] INFO: Scrape type for 1988993: 1
2026-03-27 16:35:34 [ayvens.it] INFO: Extracting data for car ID: 1988993
2026-03-27 16:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40fba7bf-5cb0-5808-b7aa-60504a424503 with identifier: 1988993
2026-03-27 16:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fba7bf-5cb0-5808-b7aa-60504a424503 with scrape type 1
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/1.jpg not downloaded yet
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/2.jpg not downloaded yet
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0ea10>
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/8.jpg saved to cache
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acccd0>
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/9.jpg saved to cache
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcacd0>
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz4%252Fc0f8df5d3ea74bc483f2f126d0a742f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/7.jpg saved to cache
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3748ba7-94b1-5a31-b860-85acd408a814
2026-03-27 16:35:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3748ba7-94b1-5a31-b860-85acd408a814, skipping ID generation
2026-03-27 16:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3748ba7-94b1-5a31-b860-85acd408a814 with scrape type 1
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3748ba7-94b1-5a31-b860-85acd408a814 sending to next pipeline
2026-03-27 16:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d3748ba7-94b1-5a31-b860-85acd408a814, identifier: 1988989
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feac50>
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/2.jpg saved to cache
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af7210>
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/1.jpg saved to cache
2026-03-27 16:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f04550>
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/3.jpg saved to cache
2026-03-27 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b9110>
2026-03-27 16:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/5.jpg saved to cache
2026-03-27 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c9f10>
2026-03-27 16:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/4.jpg saved to cache
2026-03-27 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/3.jpg not downloaded yet
2026-03-27 16:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d3748ba7-94b1-5a31-b860-85acd408a814 with identifier: 1988989
2026-03-27 16:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d3748ba7-94b1-5a31-b860-85acd408a814 with identifier: 1988989
2026-03-27 16:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d3748ba7-94b1-5a31-b860-85acd408a814 with identifier: 1988989 to the API
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PLATINUM GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'd3748ba7-94b1-5a31-b860-85acd408a814',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROËN C3 AIRCROSS PureTech 110 S&S Shine Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 60442,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532788,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496795,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3748ba7-94b1-5a31-b860-85acd408a814/d3748ba7-94b1-5a31-b860-85acd408a814_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492694,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz4/c0f8df5d3ea74bc483f2f126d0a742f8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROËN C3 AIRCROSS PureTech 110 S&S Shine Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988989%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [ayvens.it] INFO: Saving data for 1988989: {'created_time': 1774629336.082093, 'last_price_update_time': 1774629336.082105, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988989') HTTP/1.1" 204 0
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/4.jpg not downloaded yet
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/5.jpg not downloaded yet
2026-03-27 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/6.jpg not downloaded yet
2026-03-27 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/7.jpg not downloaded yet
2026-03-27 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/8.jpg not downloaded yet
2026-03-27 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/9.jpg not downloaded yet
2026-03-27 16:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/10.jpg not downloaded yet
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acec90>
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/4.jpg saved to cache
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccfa50>
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/5.jpg saved to cache
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:36 [ayvens.it] INFO: Found listing with ID: 1988994
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988994%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [ayvens.it] INFO: Scrape type for 1988994: 1
2026-03-27 16:35:36 [ayvens.it] INFO: Extracting data for car ID: 1988994
2026-03-27 16:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67 with identifier: 1988994
2026-03-27 16:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67 with scrape type 1
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/1.jpg not downloaded yet
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/2.jpg not downloaded yet
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5ef90>
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/6.jpg saved to cache
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69339bd0>
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/10.jpg saved to cache
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc0a90>
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/9.jpg saved to cache
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b4cd0>
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/2.jpg saved to cache
2026-03-27 16:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cfa150>
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/1.jpg saved to cache
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f49d0>
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/3.jpg saved to cache
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/3.jpg not downloaded yet
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/4.jpg not downloaded yet
2026-03-27 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/5.jpg not downloaded yet
2026-03-27 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/6.jpg not downloaded yet
2026-03-27 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/7.jpg not downloaded yet
2026-03-27 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/8.jpg not downloaded yet
2026-03-27 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/9.jpg not downloaded yet
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/10.jpg not downloaded yet
2026-03-27 16:35:37 [ayvens.it] INFO: Found listing with ID: 1988995
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988995%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [ayvens.it] INFO: Scrape type for 1988995: 1
2026-03-27 16:35:37 [ayvens.it] INFO: Extracting data for car ID: 1988995
2026-03-27 16:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5e3c2ef-3a49-56be-9810-7fe73d4f0699 with identifier: 1988995
2026-03-27 16:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699 with scrape type 1
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/1.jpg not downloaded yet
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fede50>
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/8.jpg saved to cache
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/2.jpg not downloaded yet
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0f350>
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/10.jpg saved to cache
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fed490>
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/9.jpg saved to cache
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bee7d0>
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/6.jpg saved to cache
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6860bbd0>
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/3.jpg saved to cache
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/3.jpg not downloaded yet
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/4.jpg not downloaded yet
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcfb90>
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/2.jpg saved to cache
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853e190>
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/5.jpg saved to cache
2026-03-27 16:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c4b90>
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/4.jpg saved to cache
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/5.jpg not downloaded yet
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/6.jpg not downloaded yet
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/7.jpg not downloaded yet
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/8.jpg not downloaded yet
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/9.jpg not downloaded yet
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/10.jpg not downloaded yet
2026-03-27 16:35:38 [ayvens.it] INFO: Found listing with ID: 1988996
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988996%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [ayvens.it] INFO: Scrape type for 1988996: 1
2026-03-27 16:35:38 [ayvens.it] INFO: Extracting data for car ID: 1988996
2026-03-27 16:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d36748-c7ae-57c7-bf20-45aef74c6bb5 with identifier: 1988996
2026-03-27 16:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5 with scrape type 1
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/1.jpg not downloaded yet
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c5e10>
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/6.jpg saved to cache
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69342c50>
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/3.jpg saved to cache
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/2.jpg not downloaded yet
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/3.jpg not downloaded yet
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69092dd0>
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/5.jpg saved to cache
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fad550>
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/4.jpg saved to cache
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c79d90>
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/1.jpg saved to cache
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cfacd0>
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/2.jpg saved to cache
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2d950>
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/1.jpg saved to cache
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bdac90>
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/10.jpg saved to cache
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/4.jpg not downloaded yet
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/5.jpg not downloaded yet
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/6.jpg not downloaded yet
2026-03-27 16:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/7.jpg not downloaded yet
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/8.jpg not downloaded yet
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/9.jpg not downloaded yet
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/10.jpg not downloaded yet
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936a410>
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/4.jpg saved to cache
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b20bd0>
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/10.jpg saved to cache
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:39 [ayvens.it] INFO: Found listing with ID: 1988997
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988997%27 HTTP/1.1" 200 None
2026-03-27 16:35:39 [ayvens.it] INFO: Scrape type for 1988997: 1
2026-03-27 16:35:39 [ayvens.it] INFO: Extracting data for car ID: 1988997
2026-03-27 16:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68213cc9-011f-5a7c-8079-9c7284a59cc2 with identifier: 1988997
2026-03-27 16:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68213cc9-011f-5a7c-8079-9c7284a59cc2 with scrape type 1
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/1.jpg not downloaded yet
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69368450>
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/9.jpg saved to cache
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923c210>
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/3.jpg saved to cache
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd0290>
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/8.jpg saved to cache
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0fc90>
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/2.jpg saved to cache
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/2.jpg not downloaded yet
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/3.jpg not downloaded yet
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bef190>
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/5.jpg saved to cache
2026-03-27 16:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68482490>
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/6.jpg saved to cache
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/4.jpg not downloaded yet
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/5.jpg not downloaded yet
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/6.jpg not downloaded yet
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/7.jpg not downloaded yet
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/8.jpg not downloaded yet
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/9.jpg not downloaded yet
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b7850>
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/8.jpg saved to cache
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69408c50>
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/6.jpg saved to cache
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/10.jpg not downloaded yet
2026-03-27 16:35:40 [ayvens.it] INFO: Found listing with ID: 1988998
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988998%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [ayvens.it] INFO: Scrape type for 1988998: 1
2026-03-27 16:35:40 [ayvens.it] INFO: Extracting data for car ID: 1988998
2026-03-27 16:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cdb0be0-4511-5b54-8d44-8294ff0d717a with identifier: 1988998
2026-03-27 16:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a with scrape type 1
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/1.jpg not downloaded yet
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/2.jpg not downloaded yet
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c69e10>
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/5.jpg saved to cache
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916e5d0>
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/4.jpg saved to cache
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68531390>
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/10.jpg saved to cache
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694db950>
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/1.jpg saved to cache
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69357e10>
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/9.jpg saved to cache
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcde10>
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/2.jpg saved to cache
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/3.jpg not downloaded yet
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/4.jpg not downloaded yet
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/5.jpg not downloaded yet
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/6.jpg not downloaded yet
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/7.jpg not downloaded yet
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/8.jpg not downloaded yet
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/9.jpg not downloaded yet
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc9fd0>
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/1.jpg saved to cache
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad13810>
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/3.jpg saved to cache
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692de090>
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/4.jpg saved to cache
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ece90>
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/8.jpg saved to cache
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/10.jpg not downloaded yet
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900a810>
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/5.jpg saved to cache
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690f0fd0>
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/9.jpg saved to cache
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfd610>
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/6.jpg saved to cache
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69425d10>
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/10.jpg saved to cache
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:35:41 [ayvens.it] INFO: Found listing with ID: 1988999
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988999%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [ayvens.it] INFO: Scrape type for 1988999: 1
2026-03-27 16:35:41 [ayvens.it] INFO: Extracting data for car ID: 1988999
2026-03-27 16:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba with identifier: 1988999
2026-03-27 16:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba with scrape type 1
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/1.jpg not downloaded yet
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/2.jpg not downloaded yet
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/3.jpg not downloaded yet
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/4.jpg not downloaded yet
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/5.jpg not downloaded yet
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/6.jpg not downloaded yet
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/7.jpg not downloaded yet
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ff7750>
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/8.jpg saved to cache
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/8.jpg not downloaded yet
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd1110>
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/10.jpg saved to cache
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c105d0>
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/3.jpg saved to cache
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/9.jpg not downloaded yet
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/10.jpg not downloaded yet
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf4810>
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/9.jpg saved to cache
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68540cd0>
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/1.jpg saved to cache
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68544350>
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/2.jpg saved to cache
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68541c90>
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/5.jpg saved to cache
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c37910>
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/4.jpg saved to cache
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:42 [ayvens.it] INFO: Found listing with ID: 1989000
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989000%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [ayvens.it] INFO: Scrape type for 1989000: 1
2026-03-27 16:35:42 [ayvens.it] INFO: Extracting data for car ID: 1989000
2026-03-27 16:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b498a8-fd79-59ae-aea1-5b205542c590 with identifier: 1989000
2026-03-27 16:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b498a8-fd79-59ae-aea1-5b205542c590 with scrape type 1
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/1.jpg not downloaded yet
2026-03-27 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/2.jpg not downloaded yet
2026-03-27 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/3.jpg not downloaded yet
2026-03-27 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/4.jpg not downloaded yet
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/5.jpg not downloaded yet
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/6.jpg not downloaded yet
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/7.jpg not downloaded yet
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690bb9d0>
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/10.jpg saved to cache
2026-03-27 16:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853d150>
2026-03-27 16:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/7.jpg saved to cache
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68455ad0>
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/9.jpg saved to cache
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/8.jpg not downloaded yet
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900a190>
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/8.jpg saved to cache
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/9.jpg not downloaded yet
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/10.jpg not downloaded yet
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69327fd0>
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/3.jpg saved to cache
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e6690>
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/4.jpg saved to cache
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec2690>
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/2.jpg saved to cache
2026-03-27 16:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e7b10>
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/1.jpg saved to cache
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:44 [ayvens.it] INFO: Found listing with ID: 1989001
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989001%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [ayvens.it] INFO: Scrape type for 1989001: 1
2026-03-27 16:35:44 [ayvens.it] INFO: Extracting data for car ID: 1989001
2026-03-27 16:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9043a0-8fcb-5fce-93c4-fced780f7a23 with identifier: 1989001
2026-03-27 16:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23 with scrape type 1
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/1.jpg not downloaded yet
2026-03-27 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/2.jpg not downloaded yet
2026-03-27 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/3.jpg not downloaded yet
2026-03-27 16:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/4.jpg not downloaded yet
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/5.jpg not downloaded yet
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/6.jpg not downloaded yet
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c8150>
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/1.jpg saved to cache
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/7.jpg not downloaded yet
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/8.jpg not downloaded yet
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/9.jpg not downloaded yet
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef7f50>
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/2.jpg saved to cache
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c35090>
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/5.jpg saved to cache
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4acd0>
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/7.jpg saved to cache
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0e5d0>
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/8.jpg saved to cache
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912f050>
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/6.jpg saved to cache
2026-03-27 16:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912f050>
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/10.jpg saved to cache
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4ab90>
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/9.jpg saved to cache
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/10.jpg not downloaded yet
2026-03-27 16:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:45 [ayvens.it] INFO: Found listing with ID: 1989002
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989002%27 HTTP/1.1" 200 None
2026-03-27 16:35:45 [ayvens.it] INFO: Scrape type for 1989002: 1
2026-03-27 16:35:45 [ayvens.it] INFO: Extracting data for car ID: 1989002
2026-03-27 16:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86eec531-30ef-54c2-ac3e-c657cd3f1f66 with identifier: 1989002
2026-03-27 16:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66 with scrape type 1
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/1.jpg not downloaded yet
2026-03-27 16:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/2.jpg not downloaded yet
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/3.jpg not downloaded yet
2026-03-27 16:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/4.jpg not downloaded yet
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685432d0>
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/10.jpg saved to cache
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/5.jpg not downloaded yet
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cfa310>
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/7.jpg saved to cache
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/6.jpg not downloaded yet
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b569d0>
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/6.jpg saved to cache
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692fa8d0>
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/9.jpg saved to cache
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ed490>
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/1.jpg saved to cache
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b02290>
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/8.jpg saved to cache
2026-03-27 16:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc7d10>
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/2.jpg saved to cache
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bda290>
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/5.jpg saved to cache
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/7.jpg not downloaded yet
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/8.jpg not downloaded yet
2026-03-27 16:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/9.jpg not downloaded yet
2026-03-27 16:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/10.jpg not downloaded yet
2026-03-27 16:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:46 [ayvens.it] INFO: Found listing with ID: 1989003
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989003%27 HTTP/1.1" 200 None
2026-03-27 16:35:46 [ayvens.it] INFO: Scrape type for 1989003: 1
2026-03-27 16:35:46 [ayvens.it] INFO: Extracting data for car ID: 1989003
2026-03-27 16:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c3136b2-8e60-56e9-9961-ff05517383db with identifier: 1989003
2026-03-27 16:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c3136b2-8e60-56e9-9961-ff05517383db with scrape type 1
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/1.jpg not downloaded yet
2026-03-27 16:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/2.jpg not downloaded yet
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916db10>
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/10.jpg saved to cache
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cf81d0>
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/3.jpg saved to cache
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69343f50>
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/4.jpg saved to cache
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690464d0>
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252Fecd3c5f1e7064ca3bbf18b0a4aa1c503%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/9.jpg saved to cache
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38b498a8-fd79-59ae-aea1-5b205542c590
2026-03-27 16:35:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38b498a8-fd79-59ae-aea1-5b205542c590, skipping ID generation
2026-03-27 16:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b498a8-fd79-59ae-aea1-5b205542c590 with scrape type 1
2026-03-27 16:35:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38b498a8-fd79-59ae-aea1-5b205542c590 sending to next pipeline
2026-03-27 16:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 38b498a8-fd79-59ae-aea1-5b205542c590, identifier: 1989000
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f7ed0>
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/1.jpg saved to cache
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6af01b10>
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/7.jpg saved to cache
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692fb1d0>
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/4.jpg saved to cache
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/3.jpg not downloaded yet
2026-03-27 16:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 38b498a8-fd79-59ae-aea1-5b205542c590 with identifier: 1989000
2026-03-27 16:35:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 38b498a8-fd79-59ae-aea1-5b205542c590 with identifier: 1989000
2026-03-27 16:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 38b498a8-fd79-59ae-aea1-5b205542c590 with identifier: 1989000 to the API
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO SOLIDO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '38b498a8-fd79-59ae-aea1-5b205542c590',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN INTERSTAR 2.3 DCI 135cv 35Q Acenta L2H2 FWD Furgone 4-door '
'(Euro 6D)',
'odometer': 64384,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525733,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489471,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563473,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447779,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b498a8-fd79-59ae-aea1-5b205542c590/38b498a8-fd79-59ae-aea1-5b205542c590_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/ecd3c5f1e7064ca3bbf18b0a4aa1c503/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN INTERSTAR 2.3 DCI 135cv 35Q Acenta L2H2 FWD Furgone '
'4-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989000%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [ayvens.it] INFO: Saving data for 1989000: {'created_time': 1774629347.617088, 'last_price_update_time': 1774629347.617099, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989000') HTTP/1.1" 204 0
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/4.jpg not downloaded yet
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/5.jpg not downloaded yet
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf6c50>
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/2.jpg saved to cache
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/6.jpg not downloaded yet
2026-03-27 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/7.jpg not downloaded yet
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/8.jpg not downloaded yet
2026-03-27 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/9.jpg not downloaded yet
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/10.jpg not downloaded yet
2026-03-27 16:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:47 [ayvens.it] INFO: Found listing with ID: 1989004
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989004%27 HTTP/1.1" 200 None
2026-03-27 16:35:47 [ayvens.it] INFO: Scrape type for 1989004: 1
2026-03-27 16:35:47 [ayvens.it] INFO: Extracting data for car ID: 1989004
2026-03-27 16:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 933bd30b-7d1c-5aac-8dcb-b5286433eb7d with identifier: 1989004
2026-03-27 16:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d with scrape type 1
2026-03-27 16:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/1.jpg not downloaded yet
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/2.jpg not downloaded yet
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c87f10>
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/10.jpg saved to cache
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0c790>
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/9.jpg saved to cache
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69514c10>
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/8.jpg saved to cache
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d00150>
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/1.jpg saved to cache
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/3.jpg not downloaded yet
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c79f90>
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/6.jpg saved to cache
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936a490>
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/3.jpg saved to cache
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68480150>
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/2.jpg saved to cache
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/4.jpg not downloaded yet
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/5.jpg not downloaded yet
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69369a10>
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/5.jpg saved to cache
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/6.jpg not downloaded yet
2026-03-27 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/7.jpg not downloaded yet
2026-03-27 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/8.jpg not downloaded yet
2026-03-27 16:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/9.jpg not downloaded yet
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/10.jpg not downloaded yet
2026-03-27 16:35:48 [ayvens.it] INFO: Found listing with ID: 1989005
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989005%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [ayvens.it] INFO: Scrape type for 1989005: 1
2026-03-27 16:35:48 [ayvens.it] INFO: Extracting data for car ID: 1989005
2026-03-27 16:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de10d698-cb9d-5bb1-a70a-941ece5a836d with identifier: 1989005
2026-03-27 16:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de10d698-cb9d-5bb1-a70a-941ece5a836d with scrape type 1
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/1.jpg not downloaded yet
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/2.jpg not downloaded yet
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bec450>
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/9.jpg saved to cache
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa18890>
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/6.jpg saved to cache
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69419450>
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/8.jpg saved to cache
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934f310>
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/3.jpg saved to cache
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69339950>
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/10.jpg saved to cache
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/3.jpg not downloaded yet
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18550>
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/7.jpg saved to cache
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68457390>
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/5.jpg saved to cache
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/4.jpg not downloaded yet
2026-03-27 16:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/5.jpg not downloaded yet
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd0410>
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F0df53af68908445cb8bcb95a2def12b1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/4.jpg saved to cache
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66
2026-03-27 16:35:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86eec531-30ef-54c2-ac3e-c657cd3f1f66, skipping ID generation
2026-03-27 16:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66 with scrape type 1
2026-03-27 16:35:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86eec531-30ef-54c2-ac3e-c657cd3f1f66 sending to next pipeline
2026-03-27 16:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 86eec531-30ef-54c2-ac3e-c657cd3f1f66, identifier: 1989002
2026-03-27 16:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 86eec531-30ef-54c2-ac3e-c657cd3f1f66 with identifier: 1989002
2026-03-27 16:35:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 86eec531-30ef-54c2-ac3e-c657cd3f1f66 with identifier: 1989002
2026-03-27 16:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 86eec531-30ef-54c2-ac3e-c657cd3f1f66 with identifier: 1989002 to the API
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Precious Silver',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '86eec531-30ef-54c2-ac3e-c657cd3f1f66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA TS 1.8 Hybrid Active SW 5-door (Euro 6D)',
'odometer': 41798,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682893,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683605,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609187,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539349,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86eec531-30ef-54c2-ac3e-c657cd3f1f66/86eec531-30ef-54c2-ac3e-c657cd3f1f66_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/0df53af68908445cb8bcb95a2def12b1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-14',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA TS 1.8 Hybrid Active SW 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989002%27 HTTP/1.1" 200 None
2026-03-27 16:35:50 [ayvens.it] INFO: Saving data for 1989002: {'created_time': 1774629350.472048, 'last_price_update_time': 1774629350.472059, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989002') HTTP/1.1" 204 0
2026-03-27 16:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/6.jpg not downloaded yet
2026-03-27 16:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/7.jpg not downloaded yet
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b70bd0>
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/6.jpg saved to cache
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/8.jpg not downloaded yet
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c6c90>
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/5.jpg saved to cache
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/9.jpg not downloaded yet
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/10.jpg not downloaded yet
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c7a10>
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/4.jpg saved to cache
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c55450>
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/2.jpg saved to cache
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b2ba50>
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/1.jpg saved to cache
2026-03-27 16:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad10590>
2026-03-27 16:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/7.jpg saved to cache
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:51 [ayvens.it] INFO: Found listing with ID: 1989006
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989006%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [ayvens.it] INFO: Scrape type for 1989006: 1
2026-03-27 16:35:51 [ayvens.it] INFO: Extracting data for car ID: 1989006
2026-03-27 16:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 245e9c8a-76b9-559e-b952-491a3676db57 with identifier: 1989006
2026-03-27 16:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 245e9c8a-76b9-559e-b952-491a3676db57 with scrape type 1
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/1.jpg not downloaded yet
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68544dd0>
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/3.jpg saved to cache
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf4210>
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/2.jpg saved to cache
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/2.jpg not downloaded yet
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694dbc50>
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/5.jpg saved to cache
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/3.jpg not downloaded yet
2026-03-27 16:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/4.jpg not downloaded yet
2026-03-27 16:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/5.jpg not downloaded yet
2026-03-27 16:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/6.jpg not downloaded yet
2026-03-27 16:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/7.jpg not downloaded yet
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/8.jpg not downloaded yet
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8cd90>
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/10.jpg saved to cache
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/9.jpg not downloaded yet
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68522890>
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/4.jpg saved to cache
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/10.jpg not downloaded yet
2026-03-27 16:35:51 [ayvens.it] INFO: Found listing with ID: 1989007
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989007%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [ayvens.it] INFO: Scrape type for 1989007: 1
2026-03-27 16:35:51 [ayvens.it] INFO: Extracting data for car ID: 1989007
2026-03-27 16:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6427477-afdc-5fd2-9142-f3ffe7111446 with identifier: 1989007
2026-03-27 16:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6427477-afdc-5fd2-9142-f3ffe7111446 with scrape type 1
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/1.jpg not downloaded yet
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925ff50>
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/7.jpg saved to cache
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb5c50>
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/6.jpg saved to cache
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf5350>
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/9.jpg saved to cache
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d22f10>
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/1.jpg saved to cache
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf66d0>
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/3.jpg saved to cache
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/2.jpg not downloaded yet
2026-03-27 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/3.jpg not downloaded yet
2026-03-27 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/4.jpg not downloaded yet
2026-03-27 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/5.jpg not downloaded yet
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/6.jpg not downloaded yet
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69324d90>
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/4.jpg saved to cache
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/7.jpg not downloaded yet
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/8.jpg not downloaded yet
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/9.jpg not downloaded yet
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b55ed0>
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/6.jpg saved to cache
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b3dd50>
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/7.jpg saved to cache
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cde850>
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/10.jpg saved to cache
2026-03-27 16:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d47e50>
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/2.jpg saved to cache
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cde910>
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/5.jpg saved to cache
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69357a50>
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/8.jpg saved to cache
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d35b50>
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/1.jpg saved to cache
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/10.jpg not downloaded yet
2026-03-27 16:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:53 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-27 16:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0ec50>
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/10.jpg saved to cache
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0e610>
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/1.jpg saved to cache
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928f1d0>
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/5.jpg saved to cache
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853cd10>
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/2.jpg saved to cache
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928f690>
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F945c0945c82d41e78f1e5e5bd8530ec9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/9.jpg saved to cache
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de10d698-cb9d-5bb1-a70a-941ece5a836d
2026-03-27 16:35:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de10d698-cb9d-5bb1-a70a-941ece5a836d, skipping ID generation
2026-03-27 16:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de10d698-cb9d-5bb1-a70a-941ece5a836d with scrape type 1
2026-03-27 16:35:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de10d698-cb9d-5bb1-a70a-941ece5a836d sending to next pipeline
2026-03-27 16:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: de10d698-cb9d-5bb1-a70a-941ece5a836d, identifier: 1989005
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3cf10>
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/3.jpg saved to cache
2026-03-27 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acf9d0>
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/4.jpg saved to cache
2026-03-27 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcc990>
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/6.jpg saved to cache
2026-03-27 16:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: de10d698-cb9d-5bb1-a70a-941ece5a836d with identifier: 1989005
2026-03-27 16:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: de10d698-cb9d-5bb1-a70a-941ece5a836d with identifier: 1989005
2026-03-27 16:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: de10d698-cb9d-5bb1-a70a-941ece5a836d with identifier: 1989005 to the API
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'de10d698-cb9d-5bb1-a70a-941ece5a836d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 AIRCROSS(PC) BLUEHDI 110 S&S SHINE',
'odometer': 65265,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 792692,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 741320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 732895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 734973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696606,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de10d698-cb9d-5bb1-a70a-941ece5a836d/de10d698-cb9d-5bb1-a70a-941ece5a836d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/945c0945c82d41e78f1e5e5bd8530ec9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 AIRCROSS(PC) BLUEHDI 110 S&S SHINE -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989005%27 HTTP/1.1" 200 None
2026-03-27 16:35:54 [ayvens.it] INFO: Saving data for 1989005: {'created_time': 1774629354.903315, 'last_price_update_time': 1774629354.903326, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989005') HTTP/1.1" 204 0
2026-03-27 16:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcc110>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/10.jpg saved to cache
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b73d0>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/2.jpg saved to cache
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd4910>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/8.jpg saved to cache
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bf6110>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/7.jpg saved to cache
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685178d0>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/6.jpg saved to cache
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b67050>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/9.jpg saved to cache
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69091510>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/1.jpg saved to cache
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b65910>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/5.jpg saved to cache
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68606350>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/3.jpg saved to cache
2026-03-27 16:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9b7d0>
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/9.jpg saved to cache
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f4310>
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk2%252F11bbbf3fa4654a1d84dc41c940e0aaed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/4.jpg saved to cache
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6427477-afdc-5fd2-9142-f3ffe7111446
2026-03-27 16:35:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6427477-afdc-5fd2-9142-f3ffe7111446, skipping ID generation
2026-03-27 16:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6427477-afdc-5fd2-9142-f3ffe7111446 with scrape type 1
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6427477-afdc-5fd2-9142-f3ffe7111446 sending to next pipeline
2026-03-27 16:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d6427477-afdc-5fd2-9142-f3ffe7111446, identifier: 1989007
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68547d90>
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/10.jpg saved to cache
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853f750>
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/9.jpg saved to cache
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6850ba90>
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F52e4dcaf8766412f97f3090d576f1d38%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/8.jpg saved to cache
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d
2026-03-27 16:35:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 933bd30b-7d1c-5aac-8dcb-b5286433eb7d, skipping ID generation
2026-03-27 16:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d with scrape type 1
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 933bd30b-7d1c-5aac-8dcb-b5286433eb7d sending to next pipeline
2026-03-27 16:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 933bd30b-7d1c-5aac-8dcb-b5286433eb7d, identifier: 1989004
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69071d90>
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/8.jpg saved to cache
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd5b90>
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk4%252F18229e3b7dfe4e87a79324571b3661e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/7.jpg saved to cache
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 245e9c8a-76b9-559e-b952-491a3676db57
2026-03-27 16:35:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 245e9c8a-76b9-559e-b952-491a3676db57, skipping ID generation
2026-03-27 16:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 245e9c8a-76b9-559e-b952-491a3676db57 with scrape type 1
2026-03-27 16:35:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 245e9c8a-76b9-559e-b952-491a3676db57 sending to next pipeline
2026-03-27 16:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 245e9c8a-76b9-559e-b952-491a3676db57, identifier: 1989006
2026-03-27 16:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d6427477-afdc-5fd2-9142-f3ffe7111446 with identifier: 1989007
2026-03-27 16:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d6427477-afdc-5fd2-9142-f3ffe7111446 with identifier: 1989007
2026-03-27 16:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d6427477-afdc-5fd2-9142-f3ffe7111446 with identifier: 1989007 to the API
2026-03-27 16:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE CELEBES METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'd6427477-afdc-5fd2-9142-f3ffe7111446',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP',
'odometer': 174738,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 748245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 748245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 850554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 884523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 883299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 699220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631215,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6427477-afdc-5fd2-9142-f3ffe7111446/d6427477-afdc-5fd2-9142-f3ffe7111446_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk2/11bbbf3fa4654a1d84dc41c940e0aaed/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989007%27 HTTP/1.1" 200 None
2026-03-27 16:35:57 [ayvens.it] INFO: Saving data for 1989007: {'created_time': 1774629357.16378, 'last_price_update_time': 1774629357.163792, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989007') HTTP/1.1" 204 0
2026-03-27 16:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 933bd30b-7d1c-5aac-8dcb-b5286433eb7d with identifier: 1989004
2026-03-27 16:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 933bd30b-7d1c-5aac-8dcb-b5286433eb7d with identifier: 1989004
2026-03-27 16:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 933bd30b-7d1c-5aac-8dcb-b5286433eb7d with identifier: 1989004 to the API
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Pure White pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '933bd30b-7d1c-5aac-8dcb-b5286433eb7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN T-CROSS 1.0 TSI Style Sport utility vehicle 5-door (Euro '
'6D)',
'odometer': 124452,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 736585,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625259,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933bd30b-7d1c-5aac-8dcb-b5286433eb7d/933bd30b-7d1c-5aac-8dcb-b5286433eb7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/52e4dcaf8766412f97f3090d576f1d38/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN T-CROSS 1.0 TSI Style Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989004%27 HTTP/1.1" 200 None
2026-03-27 16:35:57 [ayvens.it] INFO: Saving data for 1989004: {'created_time': 1774629357.539203, 'last_price_update_time': 1774629357.539213, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989004') HTTP/1.1" 204 0
2026-03-27 16:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 245e9c8a-76b9-559e-b952-491a3676db57 with identifier: 1989006
2026-03-27 16:35:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 245e9c8a-76b9-559e-b952-491a3676db57 with identifier: 1989006
2026-03-27 16:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 245e9c8a-76b9-559e-b952-491a3676db57 with identifier: 1989006 to the API
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Moonstone Grey pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '245e9c8a-76b9-559e-b952-491a3676db57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 2.0 TDI SCR 85kW Style Hatchback 5-door (Euro 6D)',
'odometer': 124184,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 833272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 833272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 899555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 911166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 848346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 734452,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 685214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245e9c8a-76b9-559e-b952-491a3676db57/245e9c8a-76b9-559e-b952-491a3676db57_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk4/18229e3b7dfe4e87a79324571b3661e7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-25',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 2.0 TDI SCR 85kW Style Hatchback 5-door '
'(Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989006%27 HTTP/1.1" 200 None
2026-03-27 16:35:57 [ayvens.it] INFO: Saving data for 1989006: {'created_time': 1774629357.904985, 'last_price_update_time': 1774629357.904998, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989006') HTTP/1.1" 204 0
2026-03-27 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1e4d0>
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl3%252F4e63cd7a4adf4492af37f02fc8016635%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/8.jpg saved to cache
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c3136b2-8e60-56e9-9961-ff05517383db
2026-03-27 16:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c3136b2-8e60-56e9-9961-ff05517383db, skipping ID generation
2026-03-27 16:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c3136b2-8e60-56e9-9961-ff05517383db with scrape type 1
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c3136b2-8e60-56e9-9961-ff05517383db sending to next pipeline
2026-03-27 16:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0c3136b2-8e60-56e9-9961-ff05517383db, identifier: 1989003
2026-03-27 16:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0c3136b2-8e60-56e9-9961-ff05517383db with identifier: 1989003
2026-03-27 16:35:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0c3136b2-8e60-56e9-9961-ff05517383db with identifier: 1989003
2026-03-27 16:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0c3136b2-8e60-56e9-9961-ff05517383db with identifier: 1989003 to the API
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO MODA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '0c3136b2-8e60-56e9-9961-ff05517383db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500L (PC) 1.3 MULTIJET 95CV CROSS FP',
'odometer': 21541,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570181,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505076,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3136b2-8e60-56e9-9961-ff05517383db/0c3136b2-8e60-56e9-9961-ff05517383db_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl3/4e63cd7a4adf4492af37f02fc8016635/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500L (PC) 1.3 MULTIJET 95CV CROSS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989003%27 HTTP/1.1" 200 None
2026-03-27 16:35:58 [ayvens.it] INFO: Saving data for 1989003: {'created_time': 1774629358.513122, 'last_price_update_time': 1774629358.513132, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989003') HTTP/1.1" 204 0
2026-03-27 16:35:58 [ayvens.it] INFO: Found listing with ID: 1989008
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989008%27 HTTP/1.1" 200 None
2026-03-27 16:35:58 [ayvens.it] INFO: Scrape type for 1989008: 1
2026-03-27 16:35:58 [ayvens.it] INFO: Extracting data for car ID: 1989008
2026-03-27 16:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96b3f6ba-e94e-539f-a450-08c85b1e3306 with identifier: 1989008
2026-03-27 16:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96b3f6ba-e94e-539f-a450-08c85b1e3306 with scrape type 1
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/1.jpg not downloaded yet
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fef8d0>
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/7.jpg saved to cache
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c69d10>
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/8.jpg saved to cache
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b0f790>
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj9%252Ffed0ef6af934439bbfb4801e3edd19c7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/3.jpg saved to cache
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba
2026-03-27 16:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba, skipping ID generation
2026-03-27 16:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba with scrape type 1
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba sending to next pipeline
2026-03-27 16:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba, identifier: 1988999
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c342d0>
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/6.jpg saved to cache
2026-03-27 16:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853dc10>
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/4.jpg saved to cache
2026-03-27 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6be90>
2026-03-27 16:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Ffd4b83e4d52a4d2da99701dda1e1c825%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/5.jpg saved to cache
2026-03-27 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a
2026-03-27 16:35:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cdb0be0-4511-5b54-8d44-8294ff0d717a, skipping ID generation
2026-03-27 16:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a with scrape type 1
2026-03-27 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cdb0be0-4511-5b54-8d44-8294ff0d717a sending to next pipeline
2026-03-27 16:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1cdb0be0-4511-5b54-8d44-8294ff0d717a, identifier: 1988998
2026-03-27 16:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e695147d0>
2026-03-27 16:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk9%252F07f9c77d35704256b5ff9d073c51dafe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/3.jpg saved to cache
2026-03-27 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23
2026-03-27 16:35:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b9043a0-8fcb-5fce-93c4-fced780f7a23, skipping ID generation
2026-03-27 16:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23 with scrape type 1
2026-03-27 16:35:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b9043a0-8fcb-5fce-93c4-fced780f7a23 sending to next pipeline
2026-03-27 16:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7b9043a0-8fcb-5fce-93c4-fced780f7a23, identifier: 1989001
2026-03-27 16:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba with identifier: 1988999
2026-03-27 16:35:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba with identifier: 1988999
2026-03-27 16:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba with identifier: 1988999 to the API
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'STING GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'd288f6bf-9aa1-5d8e-bbc4-96eb26b579ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP RENEGADE 1.6 MJet 130cv Limited Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 167554,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 766676,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 766676,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 799550,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618044,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 678121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba/d288f6bf-9aa1-5d8e-bbc4-96eb26b579ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj9/fed0ef6af934439bbfb4801e3edd19c7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP RENEGADE 1.6 MJet 130cv Limited Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988999%27 HTTP/1.1" 200 None
2026-03-27 16:35:59 [ayvens.it] INFO: Saving data for 1988999: {'created_time': 1774629359.750943, 'last_price_update_time': 1774629359.750954, 'auction_closing_time': 1774944000.0}
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988999') HTTP/1.1" 204 0
2026-03-27 16:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1cdb0be0-4511-5b54-8d44-8294ff0d717a with identifier: 1988998
2026-03-27 16:35:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1cdb0be0-4511-5b54-8d44-8294ff0d717a with identifier: 1988998
2026-03-27 16:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1cdb0be0-4511-5b54-8d44-8294ff0d717a with identifier: 1988998 to the API
2026-03-27 16:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO BRILLANTE',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '1cdb0be0-4511-5b54-8d44-8294ff0d717a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA SW (PC) 2.0 TDI EVO 85KW EXECUTIVE DSG FP',
'odometer': 136858,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 772254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 780685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 773801,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603719,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 708494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cdb0be0-4511-5b54-8d44-8294ff0d717a/1cdb0be0-4511-5b54-8d44-8294ff0d717a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618283,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/fd4b83e4d52a4d2da99701dda1e1c825/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA SW (PC) 2.0 TDI EVO 85KW EXECUTIVE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988998%27 HTTP/1.1" 200 None
2026-03-27 16:36:00 [ayvens.it] INFO: Saving data for 1988998: {'created_time': 1774629360.142332, 'last_price_update_time': 1774629360.142342, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988998') HTTP/1.1" 204 0
2026-03-27 16:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7b9043a0-8fcb-5fce-93c4-fced780f7a23 with identifier: 1989001
2026-03-27 16:36:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7b9043a0-8fcb-5fce-93c4-fced780f7a23 with identifier: 1989001
2026-03-27 16:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7b9043a0-8fcb-5fce-93c4-fced780f7a23 with identifier: 1989001 to the API
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Mineral Grey metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '7b9043a0-8fcb-5fce-93c4-fced780f7a23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 sDrive 18d Business Advantage Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 167885,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 862202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 923769,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 862202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 959980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 970863,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690369,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 717792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9043a0-8fcb-5fce-93c4-fced780f7a23/7b9043a0-8fcb-5fce-93c4-fced780f7a23_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643848,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk9/07f9c77d35704256b5ff9d073c51dafe/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 sDrive 18d Business Advantage Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989001%27 HTTP/1.1" 200 None
2026-03-27 16:36:00 [ayvens.it] INFO: Saving data for 1989001: {'created_time': 1774629360.473745, 'last_price_update_time': 1774629360.473755, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989001') HTTP/1.1" 204 0
2026-03-27 16:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/2.jpg not downloaded yet
2026-03-27 16:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/3.jpg not downloaded yet
2026-03-27 16:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934e150>
2026-03-27 16:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252F57fc0abcfcd646f3bca507b4a687b3c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/6.jpg saved to cache
2026-03-27 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68213cc9-011f-5a7c-8079-9c7284a59cc2
2026-03-27 16:36:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68213cc9-011f-5a7c-8079-9c7284a59cc2, skipping ID generation
2026-03-27 16:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68213cc9-011f-5a7c-8079-9c7284a59cc2 with scrape type 1
2026-03-27 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68213cc9-011f-5a7c-8079-9c7284a59cc2 sending to next pipeline
2026-03-27 16:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 68213cc9-011f-5a7c-8079-9c7284a59cc2, identifier: 1988997
2026-03-27 16:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/4.jpg not downloaded yet
2026-03-27 16:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 68213cc9-011f-5a7c-8079-9c7284a59cc2 with identifier: 1988997
2026-03-27 16:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 68213cc9-011f-5a7c-8079-9c7284a59cc2 with identifier: 1988997
2026-03-27 16:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 68213cc9-011f-5a7c-8079-9c7284a59cc2 with identifier: 1988997 to the API
2026-03-27 16:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '68213cc9-011f-5a7c-8079-9c7284a59cc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN GRAND C4 SPACET BLUEHDI 130 S&S EAT8 FEEL FP',
'odometer': 78095,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68213cc9-011f-5a7c-8079-9c7284a59cc2/68213cc9-011f-5a7c-8079-9c7284a59cc2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/57fc0abcfcd646f3bca507b4a687b3c6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN GRAND C4 SPACET BLUEHDI 130 S&S EAT8 FEEL FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988997%27 HTTP/1.1" 200 None
2026-03-27 16:36:01 [ayvens.it] INFO: Saving data for 1988997: {'created_time': 1774629361.142133, 'last_price_update_time': 1774629361.142144, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988997') HTTP/1.1" 204 0
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/5.jpg not downloaded yet
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69092810>
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/8.jpg saved to cache
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2ee50>
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/7.jpg saved to cache
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b20050>
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz2%252F6615376cf4594b9d886bd5eb94f1def4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/7.jpg saved to cache
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699
2026-03-27 16:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5e3c2ef-3a49-56be-9810-7fe73d4f0699, skipping ID generation
2026-03-27 16:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699 with scrape type 1
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5e3c2ef-3a49-56be-9810-7fe73d4f0699 sending to next pipeline
2026-03-27 16:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b5e3c2ef-3a49-56be-9810-7fe73d4f0699, identifier: 1988995
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bffa50>
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F332b0f438f354b1d9eddf29328e80e25%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/7.jpg saved to cache
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5
2026-03-27 16:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1d36748-c7ae-57c7-bf20-45aef74c6bb5, skipping ID generation
2026-03-27 16:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5 with scrape type 1
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1d36748-c7ae-57c7-bf20-45aef74c6bb5 sending to next pipeline
2026-03-27 16:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d1d36748-c7ae-57c7-bf20-45aef74c6bb5, identifier: 1988996
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69281210>
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw1%252F6e60e2860b3c48b68acb0ac5f1054f6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/7.jpg saved to cache
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40fba7bf-5cb0-5808-b7aa-60504a424503
2026-03-27 16:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40fba7bf-5cb0-5808-b7aa-60504a424503, skipping ID generation
2026-03-27 16:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fba7bf-5cb0-5808-b7aa-60504a424503 with scrape type 1
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40fba7bf-5cb0-5808-b7aa-60504a424503 sending to next pipeline
2026-03-27 16:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 40fba7bf-5cb0-5808-b7aa-60504a424503, identifier: 1988993
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b8150>
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz1%252Fbb6b54f0f16c472cacdb0a7946199428%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/7.jpg saved to cache
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67
2026-03-27 16:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67, skipping ID generation
2026-03-27 16:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67 with scrape type 1
2026-03-27 16:36:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67 sending to next pipeline
2026-03-27 16:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67, identifier: 1988994
2026-03-27 16:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b5e3c2ef-3a49-56be-9810-7fe73d4f0699 with identifier: 1988995
2026-03-27 16:36:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b5e3c2ef-3a49-56be-9810-7fe73d4f0699 with identifier: 1988995
2026-03-27 16:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b5e3c2ef-3a49-56be-9810-7fe73d4f0699 with identifier: 1988995 to the API
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO LUGANO MTZ',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.9L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'electric',
'id': 'b5e3c2ef-3a49-56be-9810-7fe73d4f0699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES VITO (ARMADA) E-VITO LONG',
'odometer': 44933,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 69,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478385,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527242,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396765,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464921,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5e3c2ef-3a49-56be-9810-7fe73d4f0699/b5e3c2ef-3a49-56be-9810-7fe73d4f0699_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz2/6615376cf4594b9d886bd5eb94f1def4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES VITO (ARMADA) E-VITO LONG -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988995%27 HTTP/1.1" 200 None
2026-03-27 16:36:02 [ayvens.it] INFO: Saving data for 1988995: {'created_time': 1774629362.473002, 'last_price_update_time': 1774629362.473012, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988995') HTTP/1.1" 204 0
2026-03-27 16:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d1d36748-c7ae-57c7-bf20-45aef74c6bb5 with identifier: 1988996
2026-03-27 16:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d1d36748-c7ae-57c7-bf20-45aef74c6bb5 with identifier: 1988996
2026-03-27 16:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d1d36748-c7ae-57c7-bf20-45aef74c6bb5 with identifier: 1988996 to the API
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO FLORET METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'd1d36748-c7ae-57c7-bf20-45aef74c6bb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q8 (PC) 55 TFSI E 280KW QUATTRO TIP. SPORT FP',
'odometer': 146199,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575593,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d36748-c7ae-57c7-bf20-45aef74c6bb5/d1d36748-c7ae-57c7-bf20-45aef74c6bb5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/332b0f438f354b1d9eddf29328e80e25/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-04',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q8 (PC) 55 TFSI E 280KW QUATTRO TIP. SPORT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988996%27 HTTP/1.1" 200 None
2026-03-27 16:36:02 [ayvens.it] INFO: Saving data for 1988996: {'created_time': 1774629362.834829, 'last_price_update_time': 1774629362.83484, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988996') HTTP/1.1" 204 0
2026-03-27 16:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 40fba7bf-5cb0-5808-b7aa-60504a424503 with identifier: 1988993
2026-03-27 16:36:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 40fba7bf-5cb0-5808-b7aa-60504a424503 with identifier: 1988993
2026-03-27 16:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 40fba7bf-5cb0-5808-b7aa-60504a424503 with identifier: 1988993 to the API
2026-03-27 16:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Sovereign Silver metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '40fba7bf-5cb0-5808-b7aa-60504a424503',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL ASTRA ST 1.6 CDTI Business 136cv AT6 SW 5-door (Euro 6.2)',
'odometer': 152682,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 46,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665256,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556692,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fba7bf-5cb0-5808-b7aa-60504a424503/40fba7bf-5cb0-5808-b7aa-60504a424503_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw1/6e60e2860b3c48b68acb0ac5f1054f6e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL ASTRA ST 1.6 CDTI Business 136cv AT6 SW 5-door (Euro 6.2) '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988993%27 HTTP/1.1" 200 None
2026-03-27 16:36:03 [ayvens.it] INFO: Saving data for 1988993: {'created_time': 1774629363.689576, 'last_price_update_time': 1774629363.689585, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988993') HTTP/1.1" 204 0
2026-03-27 16:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67 with identifier: 1988994
2026-03-27 16:36:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67 with identifier: 1988994
2026-03-27 16:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67 with identifier: 1988994 to the API
2026-03-27 16:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio Stromboli metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO 2.2 Turbo Diesel 190CV AT8 Q4 Business Sport '
'utility vehicle 5-door (Euro 6.2)',
'odometer': 177461,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 43,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588067,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589246,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547998,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67/1a2cd9b8-b847-5dbb-bc54-16f36a0e7e67_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz1/bb6b54f0f16c472cacdb0a7946199428/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO 2.2 Turbo Diesel 190CV AT8 Q4 '
'Business Sport utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988994%27 HTTP/1.1" 200 None
2026-03-27 16:36:04 [ayvens.it] INFO: Saving data for 1988994: {'created_time': 1774629364.017651, 'last_price_update_time': 1774629364.01766, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988994') HTTP/1.1" 204 0
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/6.jpg not downloaded yet
2026-03-27 16:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2d150>
2026-03-27 16:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft1%252F8c339809e7124ea0b94e7d6aa9287d55%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/9.jpg saved to cache
2026-03-27 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a13099a7-a715-5c90-a22f-89fb0d1d952b
2026-03-27 16:36:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a13099a7-a715-5c90-a22f-89fb0d1d952b, skipping ID generation
2026-03-27 16:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a13099a7-a715-5c90-a22f-89fb0d1d952b with scrape type 1
2026-03-27 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a13099a7-a715-5c90-a22f-89fb0d1d952b sending to next pipeline
2026-03-27 16:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a13099a7-a715-5c90-a22f-89fb0d1d952b, identifier: 1988992
2026-03-27 16:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a13099a7-a715-5c90-a22f-89fb0d1d952b with identifier: 1988992
2026-03-27 16:36:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a13099a7-a715-5c90-a22f-89fb0d1d952b with identifier: 1988992
2026-03-27 16:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a13099a7-a715-5c90-a22f-89fb0d1d952b with identifier: 1988992 to the API
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blu Iron opaco',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'a13099a7-a715-5c90-a22f-89fb0d1d952b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT CLIO 1.2 16v Zen Hatchback 5-door',
'odometer': 82125,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 72,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 970937,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 921835,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 970937,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 992896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1002738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 741978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 814362,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13099a7-a715-5c90-a22f-89fb0d1d952b/a13099a7-a715-5c90-a22f-89fb0d1d952b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft1/8c339809e7124ea0b94e7d6aa9287d55/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT CLIO 1.2 16v Zen Hatchback 5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988992%27 HTTP/1.1" 200 None
2026-03-27 16:36:04 [ayvens.it] INFO: Saving data for 1988992: {'created_time': 1774629364.858447, 'last_price_update_time': 1774629364.858459, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988992') HTTP/1.1" 204 0
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/7.jpg not downloaded yet
2026-03-27 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/8.jpg not downloaded yet
2026-03-27 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/9.jpg not downloaded yet
2026-03-27 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/10.jpg not downloaded yet
2026-03-27 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:04 [ayvens.it] INFO: Found listing with ID: 1989009
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989009%27 HTTP/1.1" 200 None
2026-03-27 16:36:04 [ayvens.it] INFO: Scrape type for 1989009: 1
2026-03-27 16:36:04 [ayvens.it] INFO: Extracting data for car ID: 1989009
2026-03-27 16:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d19a73cb-0248-50eb-9fea-a78eea5dc241 with identifier: 1989009
2026-03-27 16:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19a73cb-0248-50eb-9fea-a78eea5dc241 with scrape type 1
2026-03-27 16:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/1.jpg not downloaded yet
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/2.jpg not downloaded yet
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68abd750>
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/10.jpg saved to cache
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c78310>
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz9%252F0f1d1771db1f436293bf529553e31ef4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/7.jpg saved to cache
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6081d2f1-948b-59ab-a893-672bf785d5ee
2026-03-27 16:36:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6081d2f1-948b-59ab-a893-672bf785d5ee, skipping ID generation
2026-03-27 16:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6081d2f1-948b-59ab-a893-672bf785d5ee with scrape type 1
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6081d2f1-948b-59ab-a893-672bf785d5ee sending to next pipeline
2026-03-27 16:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6081d2f1-948b-59ab-a893-672bf785d5ee, identifier: 1988991
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/3.jpg not downloaded yet
2026-03-27 16:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6081d2f1-948b-59ab-a893-672bf785d5ee with identifier: 1988991
2026-03-27 16:36:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6081d2f1-948b-59ab-a893-672bf785d5ee with identifier: 1988991
2026-03-27 16:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6081d2f1-948b-59ab-a893-672bf785d5ee with identifier: 1988991 to the API
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Platinum Grey',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '6081d2f1-948b-59ab-a893-672bf785d5ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROËN C3 PureTech 83 S&S Feel Neo patentati Hatchback 5-door '
'(Euro 6D)',
'odometer': 64587,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542736,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542736,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6081d2f1-948b-59ab-a893-672bf785d5ee/6081d2f1-948b-59ab-a893-672bf785d5ee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573256,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz9/0f1d1771db1f436293bf529553e31ef4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROËN C3 PureTech 83 S&S Feel Neo patentati Hatchback '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988991%27 HTTP/1.1" 200 None
2026-03-27 16:36:05 [ayvens.it] INFO: Saving data for 1988991: {'created_time': 1774629365.645811, 'last_price_update_time': 1774629365.645821, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988991') HTTP/1.1" 204 0
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685237d0>
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/7.jpg saved to cache
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0d750>
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/6.jpg saved to cache
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb2150>
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx0%252F08fedba95dd44457bf489cce7a0ae97f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/8.jpg saved to cache
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 770bea77-eeca-5623-a99f-0477f5713f35
2026-03-27 16:36:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 770bea77-eeca-5623-a99f-0477f5713f35, skipping ID generation
2026-03-27 16:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770bea77-eeca-5623-a99f-0477f5713f35 with scrape type 1
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 770bea77-eeca-5623-a99f-0477f5713f35 sending to next pipeline
2026-03-27 16:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 770bea77-eeca-5623-a99f-0477f5713f35, identifier: 1988990
2026-03-27 16:36:05 [scrapy.extensions.logstats] INFO: Crawled 19 pages (at 4 pages/min), scraped 139 items (at 25 items/min)
2026-03-27 16:36:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/4.jpg not downloaded yet
2026-03-27 16:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 770bea77-eeca-5623-a99f-0477f5713f35 with identifier: 1988990
2026-03-27 16:36:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 770bea77-eeca-5623-a99f-0477f5713f35 with identifier: 1988990
2026-03-27 16:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 770bea77-eeca-5623-a99f-0477f5713f35 with identifier: 1988990 to the API
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Narvik Black pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '770bea77-eeca-5623-a99f-0477f5713f35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 150cv SE 4WD Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 127821,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 818213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 818213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 852516,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 815580,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770bea77-eeca-5623-a99f-0477f5713f35/770bea77-eeca-5623-a99f-0477f5713f35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597229,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx0/08fedba95dd44457bf489cce7a0ae97f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 150cv SE 4WD Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988990%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [ayvens.it] INFO: Saving data for 1988990: {'created_time': 1774629366.367206, 'last_price_update_time': 1774629366.367216, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988990') HTTP/1.1" 204 0
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6add5890>
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/9.jpg saved to cache
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936bcd0>
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/2.jpg saved to cache
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5d2d0>
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/1.jpg saved to cache
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/5.jpg not downloaded yet
2026-03-27 16:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/6.jpg not downloaded yet
2026-03-27 16:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/7.jpg not downloaded yet
2026-03-27 16:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/8.jpg not downloaded yet
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/9.jpg not downloaded yet
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/10.jpg not downloaded yet
2026-03-27 16:36:06 [ayvens.it] INFO: Found listing with ID: 1989010
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989010%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [ayvens.it] INFO: Scrape type for 1989010: 1
2026-03-27 16:36:06 [ayvens.it] INFO: Extracting data for car ID: 1989010
2026-03-27 16:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38f6d02b-c69b-5d46-9133-ea0f4669d61d with identifier: 1989010
2026-03-27 16:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d with scrape type 1
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/1.jpg not downloaded yet
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/2.jpg not downloaded yet
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef6490>
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/7.jpg saved to cache
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c54410>
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs3%252Fda9727a8b96a4556b22e2b1e34e872d3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/8.jpg saved to cache
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0
2026-03-27 16:36:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0, skipping ID generation
2026-03-27 16:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0 with scrape type 1
2026-03-27 16:36:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0 sending to next pipeline
2026-03-27 16:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0, identifier: 1988988
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5e290>
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/10.jpg saved to cache
2026-03-27 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/3.jpg not downloaded yet
2026-03-27 16:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0 with identifier: 1988988
2026-03-27 16:36:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0 with identifier: 1988988
2026-03-27 16:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0080b7ef-71fc-5a6a-ab2d-da4a717e96b0 with identifier: 1988988 to the API
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '0080b7ef-71fc-5a6a-ab2d-da4a717e96b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO MAXI 35 LH1 2.3 Multijet 130CV 6M D.Cab. Tel.Dop.Cab. '
'4-door',
'odometer': 106881,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 55,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545268,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603680,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 565864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0080b7ef-71fc-5a6a-ab2d-da4a717e96b0/0080b7ef-71fc-5a6a-ab2d-da4a717e96b0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs3/da9727a8b96a4556b22e2b1e34e872d3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO MAXI 35 LH1 2.3 Multijet 130CV 6M D.Cab. '
'Tel.Dop.Cab. 4-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988988%27 HTTP/1.1" 200 None
2026-03-27 16:36:07 [ayvens.it] INFO: Saving data for 1988988: {'created_time': 1774629367.540335, 'last_price_update_time': 1774629367.540345, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988988') HTTP/1.1" 204 0
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af5e10>
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/5.jpg saved to cache
2026-03-27 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e698ea910>
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/9.jpg saved to cache
2026-03-27 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912e9d0>
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/10.jpg saved to cache
2026-03-27 16:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b5610>
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/7.jpg saved to cache
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69338c90>
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn5%252F765c24c48d524d92bc665917001c0c0c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/8.jpg saved to cache
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21faf328-af9b-58aa-9903-328fe045615b
2026-03-27 16:36:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21faf328-af9b-58aa-9903-328fe045615b, skipping ID generation
2026-03-27 16:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21faf328-af9b-58aa-9903-328fe045615b with scrape type 1
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21faf328-af9b-58aa-9903-328fe045615b sending to next pipeline
2026-03-27 16:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 21faf328-af9b-58aa-9903-328fe045615b, identifier: 1988986
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/4.jpg not downloaded yet
2026-03-27 16:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 21faf328-af9b-58aa-9903-328fe045615b with identifier: 1988986
2026-03-27 16:36:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 21faf328-af9b-58aa-9903-328fe045615b with identifier: 1988986
2026-03-27 16:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 21faf328-af9b-58aa-9903-328fe045615b with identifier: 1988986 to the API
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Ducato pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '21faf328-af9b-58aa-9903-328fe045615b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO MAXI 35 XLH3 2.3 Multijet 130CV 6M Furgone 4-door',
'odometer': 246881,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 109,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/1.jpeg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609389,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21faf328-af9b-58aa-9903-328fe045615b/21faf328-af9b-58aa-9903-328fe045615b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501564,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn5/765c24c48d524d92bc665917001c0c0c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-05',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO MAXI 35 XLH3 2.3 Multijet 130CV 6M Furgone 4-door '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988986%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [ayvens.it] INFO: Saving data for 1988986: {'created_time': 1774629368.547833, 'last_price_update_time': 1774629368.547845, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988986') HTTP/1.1" 204 0
2026-03-27 16:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/5.jpg not downloaded yet
2026-03-27 16:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/6.jpg not downloaded yet
2026-03-27 16:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/7.jpg not downloaded yet
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/8.jpg not downloaded yet
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/9.jpg not downloaded yet
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/10.jpg not downloaded yet
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcf610>
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/7.jpg saved to cache
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:36:08 [ayvens.it] INFO: Found listing with ID: 1989011
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989011%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [ayvens.it] INFO: Scrape type for 1989011: 1
2026-03-27 16:36:08 [ayvens.it] INFO: Extracting data for car ID: 1989011
2026-03-27 16:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8bbf80b-53c9-5456-a0de-ba8d60874d64 with identifier: 1989011
2026-03-27 16:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bbf80b-53c9-5456-a0de-ba8d60874d64 with scrape type 1
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/1.jpg not downloaded yet
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc6290>
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/2.jpg saved to cache
2026-03-27 16:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/2.jpg not downloaded yet
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/3.jpg not downloaded yet
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68509950>
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/3.jpg saved to cache
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccd710>
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/1.jpg saved to cache
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc5010>
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/6.jpg saved to cache
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fce210>
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/8.jpg saved to cache
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6940a990>
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/3.jpg saved to cache
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccdc10>
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/4.jpg saved to cache
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/4.jpg not downloaded yet
2026-03-27 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/5.jpg not downloaded yet
2026-03-27 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/6.jpg not downloaded yet
2026-03-27 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/7.jpg not downloaded yet
2026-03-27 16:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/8.jpg not downloaded yet
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/9.jpg not downloaded yet
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69162a90>
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/5.jpg saved to cache
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/10.jpg not downloaded yet
2026-03-27 16:36:09 [ayvens.it] INFO: Found listing with ID: 1989012
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989012%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [ayvens.it] INFO: Scrape type for 1989012: 1
2026-03-27 16:36:09 [ayvens.it] INFO: Extracting data for car ID: 1989012
2026-03-27 16:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 147811b0-4ce8-53f7-85a2-ab7f36dc892b with identifier: 1989012
2026-03-27 16:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b with scrape type 1
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/1.jpg not downloaded yet
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/2.jpg not downloaded yet
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b65410>
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/6.jpg saved to cache
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b66cd0>
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/4.jpg saved to cache
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca0bd0>
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/10.jpg saved to cache
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6bb10>
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/9.jpg saved to cache
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68607f50>
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/1.jpg saved to cache
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690923d0>
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/3.jpg saved to cache
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68521d50>
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/2.jpg saved to cache
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/3.jpg not downloaded yet
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/4.jpg not downloaded yet
2026-03-27 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/5.jpg not downloaded yet
2026-03-27 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/6.jpg not downloaded yet
2026-03-27 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/7.jpg not downloaded yet
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/8.jpg not downloaded yet
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/9.jpg not downloaded yet
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/10.jpg not downloaded yet
2026-03-27 16:36:10 [ayvens.it] INFO: Found listing with ID: 1989013
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989013%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [ayvens.it] INFO: Scrape type for 1989013: 1
2026-03-27 16:36:10 [ayvens.it] INFO: Extracting data for car ID: 1989013
2026-03-27 16:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36617924-7fcb-5e90-a1c7-d83c6e76e154 with identifier: 1989013
2026-03-27 16:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36617924-7fcb-5e90-a1c7-d83c6e76e154 with scrape type 1
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/1.jpg not downloaded yet
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba9bd0>
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/10.jpg saved to cache
2026-03-27 16:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba1a10>
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/9.jpg saved to cache
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba3210>
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/8.jpg saved to cache
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/2.jpg not downloaded yet
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d47bd0>
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/4.jpg saved to cache
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68530e10>
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/7.jpg saved to cache
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b30b90>
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/5.jpg saved to cache
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc0cd0>
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/1.jpg saved to cache
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bab2d0>
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252Fc238cd68f53d4070be06f41d0c67b8f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/6.jpg saved to cache
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d
2026-03-27 16:36:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38f6d02b-c69b-5d46-9133-ea0f4669d61d, skipping ID generation
2026-03-27 16:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d with scrape type 1
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38f6d02b-c69b-5d46-9133-ea0f4669d61d sending to next pipeline
2026-03-27 16:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 38f6d02b-c69b-5d46-9133-ea0f4669d61d, identifier: 1989010
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/3.jpg not downloaded yet
2026-03-27 16:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 38f6d02b-c69b-5d46-9133-ea0f4669d61d with identifier: 1989010
2026-03-27 16:36:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 38f6d02b-c69b-5d46-9133-ea0f4669d61d with identifier: 1989010
2026-03-27 16:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 38f6d02b-c69b-5d46-9133-ea0f4669d61d with identifier: 1989010 to the API
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'KHAKI GREY PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '38f6d02b-c69b-5d46-9133-ea0f4669d61d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 AIRCROSS BLUEHDI 120 S&S SHINE EAT6 FP',
'odometer': 80891,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 830252,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 836336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 830252,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829109,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 826557,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624382,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38f6d02b-c69b-5d46-9133-ea0f4669d61d/38f6d02b-c69b-5d46-9133-ea0f4669d61d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/c238cd68f53d4070be06f41d0c67b8f8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 AIRCROSS BLUEHDI 120 S&S SHINE EAT6 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989010%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [ayvens.it] INFO: Saving data for 1989010: {'created_time': 1774629372.34757, 'last_price_update_time': 1774629372.347584, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989010') HTTP/1.1" 204 0
2026-03-27 16:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/4.jpg not downloaded yet
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/5.jpg not downloaded yet
2026-03-27 16:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/6.jpg not downloaded yet
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/7.jpg not downloaded yet
2026-03-27 16:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/8.jpg not downloaded yet
2026-03-27 16:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/9.jpg not downloaded yet
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecc250>
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/8.jpg saved to cache
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/10.jpg not downloaded yet
2026-03-27 16:36:12 [ayvens.it] INFO: Found listing with ID: 1989014
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989014%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [ayvens.it] INFO: Scrape type for 1989014: 1
2026-03-27 16:36:12 [ayvens.it] INFO: Extracting data for car ID: 1989014
2026-03-27 16:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c4fea4-1b70-5706-b4e8-2ed3056198a1 with identifier: 1989014
2026-03-27 16:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1 with scrape type 1
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/1.jpg not downloaded yet
2026-03-27 16:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/2.jpg not downloaded yet
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c5610>
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/2.jpg saved to cache
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936abd0>
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/3.jpg saved to cache
2026-03-27 16:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba27d0>
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/1.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69143cd0>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/3.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ee9d0>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/2.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ef1d0>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/5.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6936ae50>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/4.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/3.jpg not downloaded yet
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/4.jpg not downloaded yet
2026-03-27 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b4e90>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/4.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/5.jpg not downloaded yet
2026-03-27 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/6.jpg not downloaded yet
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/7.jpg not downloaded yet
2026-03-27 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/8.jpg not downloaded yet
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d22290>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/5.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693552d0>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/10.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/9.jpg not downloaded yet
2026-03-27 16:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69325410>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/7.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b650d0>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/8.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6a210>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/2.jpg saved to cache
2026-03-27 16:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af7990>
2026-03-27 16:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/9.jpg saved to cache
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f60d0>
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/1.jpg saved to cache
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/10.jpg not downloaded yet
2026-03-27 16:36:14 [ayvens.it] INFO: Found listing with ID: 1989015
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989015%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [ayvens.it] INFO: Scrape type for 1989015: 1
2026-03-27 16:36:14 [ayvens.it] INFO: Extracting data for car ID: 1989015
2026-03-27 16:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8 with identifier: 1989015
2026-03-27 16:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8 with scrape type 1
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/1.jpg not downloaded yet
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c9690>
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/3.jpg saved to cache
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/2.jpg not downloaded yet
2026-03-27 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/3.jpg not downloaded yet
2026-03-27 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/4.jpg not downloaded yet
2026-03-27 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/5.jpg not downloaded yet
2026-03-27 16:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/6.jpg not downloaded yet
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69028990>
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/10.jpg saved to cache
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/7.jpg not downloaded yet
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e5f90>
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/5.jpg saved to cache
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68500290>
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/1.jpg saved to cache
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684c5490>
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/4.jpg saved to cache
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b57d90>
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/10.jpg saved to cache
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/8.jpg not downloaded yet
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/9.jpg not downloaded yet
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68606950>
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/2.jpg saved to cache
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6941afd0>
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/9.jpg saved to cache
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69325410>
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/8.jpg saved to cache
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/10.jpg not downloaded yet
2026-03-27 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:15 [ayvens.it] INFO: Found listing with ID: 1989016
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989016%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [ayvens.it] INFO: Scrape type for 1989016: 1
2026-03-27 16:36:15 [ayvens.it] INFO: Extracting data for car ID: 1989016
2026-03-27 16:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df7ffd21-0a9b-52bf-8e1f-231846844457 with identifier: 1989016
2026-03-27 16:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df7ffd21-0a9b-52bf-8e1f-231846844457 with scrape type 1
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/1.jpg not downloaded yet
2026-03-27 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/2.jpg not downloaded yet
2026-03-27 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/3.jpg not downloaded yet
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/4.jpg not downloaded yet
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/5.jpg not downloaded yet
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6941b3d0>
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/4.jpg saved to cache
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/6.jpg not downloaded yet
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18f50>
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/9.jpg saved to cache
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923e6d0>
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/6.jpg saved to cache
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916d8d0>
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/8.jpg saved to cache
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/7.jpg not downloaded yet
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/8.jpg not downloaded yet
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba1250>
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252Fcdf4f0f07041477fbc302750ca649c4e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/7.jpg saved to cache
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36617924-7fcb-5e90-a1c7-d83c6e76e154
2026-03-27 16:36:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36617924-7fcb-5e90-a1c7-d83c6e76e154, skipping ID generation
2026-03-27 16:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36617924-7fcb-5e90-a1c7-d83c6e76e154 with scrape type 1
2026-03-27 16:36:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36617924-7fcb-5e90-a1c7-d83c6e76e154 sending to next pipeline
2026-03-27 16:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 36617924-7fcb-5e90-a1c7-d83c6e76e154, identifier: 1989013
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e786d8610>
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/3.jpg saved to cache
2026-03-27 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69161850>
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/7.jpg saved to cache
2026-03-27 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68509850>
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/8.jpg saved to cache
2026-03-27 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 36617924-7fcb-5e90-a1c7-d83c6e76e154 with identifier: 1989013
2026-03-27 16:36:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 36617924-7fcb-5e90-a1c7-d83c6e76e154 with identifier: 1989013
2026-03-27 16:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 36617924-7fcb-5e90-a1c7-d83c6e76e154 with identifier: 1989013 to the API
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '36617924-7fcb-5e90-a1c7-d83c6e76e154',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 40 TDI Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D) mild hybrid',
'odometer': 64254,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 612055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36617924-7fcb-5e90-a1c7-d83c6e76e154/36617924-7fcb-5e90-a1c7-d83c6e76e154_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/cdf4f0f07041477fbc302750ca649c4e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 40 TDI Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989013%27 HTTP/1.1" 200 None
2026-03-27 16:36:16 [ayvens.it] INFO: Saving data for 1989013: {'created_time': 1774629376.849095, 'last_price_update_time': 1774629376.849107, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989013') HTTP/1.1" 204 0
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/9.jpg not downloaded yet
2026-03-27 16:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/10.jpg not downloaded yet
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [ayvens.it] INFO: Found listing with ID: 1989017
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989017%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [ayvens.it] INFO: Scrape type for 1989017: 1
2026-03-27 16:36:17 [ayvens.it] INFO: Extracting data for car ID: 1989017
2026-03-27 16:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a51038-d3b9-526e-aecf-9cdea16374f6 with identifier: 1989017
2026-03-27 16:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a51038-d3b9-526e-aecf-9cdea16374f6 with scrape type 1
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/1.jpg not downloaded yet
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/2.jpg not downloaded yet
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/3.jpg not downloaded yet
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c35ad0>
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/1.jpg saved to cache
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b86d0>
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/10.jpg saved to cache
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdef10>
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/9.jpg saved to cache
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68541590>
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/2.jpg saved to cache
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b92d0>
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/3.jpg saved to cache
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f1d10>
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/6.jpg saved to cache
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b32810>
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/6.jpg saved to cache
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/4.jpg not downloaded yet
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/5.jpg not downloaded yet
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/6.jpg not downloaded yet
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69281f90>
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/7.jpg saved to cache
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/7.jpg not downloaded yet
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/8.jpg not downloaded yet
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/9.jpg not downloaded yet
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/10.jpg not downloaded yet
2026-03-27 16:36:17 [ayvens.it] INFO: Found listing with ID: 1989018
2026-03-27 16:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989018%27 HTTP/1.1" 200 None
2026-03-27 16:36:18 [ayvens.it] INFO: Scrape type for 1989018: 1
2026-03-27 16:36:18 [ayvens.it] INFO: Extracting data for car ID: 1989018
2026-03-27 16:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5ee3c2b-809f-502b-99b1-5b0e4512eee2 with identifier: 1989018
2026-03-27 16:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2 with scrape type 1
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/1.jpg not downloaded yet
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/2.jpg not downloaded yet
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba8390>
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/10.jpg saved to cache
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69418050>
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/8.jpg saved to cache
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/3.jpg not downloaded yet
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68955690>
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/5.jpg saved to cache
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/4.jpg not downloaded yet
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/5.jpg not downloaded yet
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925e090>
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/9.jpg saved to cache
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bdbd50>
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/1.jpg saved to cache
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68520c10>
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/6.jpg saved to cache
2026-03-27 16:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6860b150>
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9939110fc88d4b2b97782e1e29daa96a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/4.jpg saved to cache
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8
2026-03-27 16:36:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8, skipping ID generation
2026-03-27 16:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8 with scrape type 1
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8 sending to next pipeline
2026-03-27 16:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8, identifier: 1989015
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b200d0>
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/5.jpg saved to cache
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8 with identifier: 1989015
2026-03-27 16:36:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8 with identifier: 1989015
2026-03-27 16:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2ffb99e5-1710-5d89-bfdf-7d8c01e47be8 with identifier: 1989015 to the API
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Alpine white pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '2ffb99e5-1710-5d89-bfdf-7d8c01e47be8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 sDrive 18d Edition Essence DCT Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 132092,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711694,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 751332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686884,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559268,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529790,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ffb99e5-1710-5d89-bfdf-7d8c01e47be8/2ffb99e5-1710-5d89-bfdf-7d8c01e47be8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9939110fc88d4b2b97782e1e29daa96a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 sDrive 18d Edition Essence DCT Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989015%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [ayvens.it] INFO: Saving data for 1989015: {'created_time': 1774629379.647317, 'last_price_update_time': 1774629379.647327, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989015') HTTP/1.1" 204 0
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/6.jpg not downloaded yet
2026-03-27 16:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/7.jpg not downloaded yet
2026-03-27 16:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/8.jpg not downloaded yet
2026-03-27 16:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/9.jpg not downloaded yet
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/10.jpg not downloaded yet
2026-03-27 16:36:19 [ayvens.it] INFO: Found listing with ID: 1989019
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989019%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [ayvens.it] INFO: Scrape type for 1989019: 1
2026-03-27 16:36:19 [ayvens.it] INFO: Extracting data for car ID: 1989019
2026-03-27 16:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2622d29-41c8-591b-af64-f21f75dba134 with identifier: 1989019
2026-03-27 16:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2622d29-41c8-591b-af64-f21f75dba134 with scrape type 1
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/1.jpg not downloaded yet
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/2.jpg not downloaded yet
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e786f0710>
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/8.jpg saved to cache
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68612d90>
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/4.jpg saved to cache
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/3.jpg not downloaded yet
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c5550>
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/9.jpg saved to cache
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc7dd0>
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/7.jpg saved to cache
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdc990>
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/10.jpg saved to cache
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc4e50>
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/2.jpg saved to cache
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/4.jpg not downloaded yet
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/5.jpg not downloaded yet
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d375d0>
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/3.jpg saved to cache
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef5410>
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F008d0373a6dc47f5bb0d8d27287fdad1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/4.jpg saved to cache
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df7ffd21-0a9b-52bf-8e1f-231846844457
2026-03-27 16:36:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df7ffd21-0a9b-52bf-8e1f-231846844457, skipping ID generation
2026-03-27 16:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df7ffd21-0a9b-52bf-8e1f-231846844457 with scrape type 1
2026-03-27 16:36:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df7ffd21-0a9b-52bf-8e1f-231846844457 sending to next pipeline
2026-03-27 16:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: df7ffd21-0a9b-52bf-8e1f-231846844457, identifier: 1989016
2026-03-27 16:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: df7ffd21-0a9b-52bf-8e1f-231846844457 with identifier: 1989016
2026-03-27 16:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: df7ffd21-0a9b-52bf-8e1f-231846844457 with identifier: 1989016
2026-03-27 16:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: df7ffd21-0a9b-52bf-8e1f-231846844457 with identifier: 1989016 to the API
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'df7ffd21-0a9b-52bf-8e1f-231846844457',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE X AUT FP',
'odometer': 140909,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587503,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7ffd21-0a9b-52bf-8e1f-231846844457/df7ffd21-0a9b-52bf-8e1f-231846844457_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562949,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/008d0373a6dc47f5bb0d8d27287fdad1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 BENZINA FHEV 190CV AWD ST-LINE X AUT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989016%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [ayvens.it] INFO: Saving data for 1989016: {'created_time': 1774629381.020185, 'last_price_update_time': 1774629381.020197, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989016') HTTP/1.1" 204 0
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/6.jpg not downloaded yet
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/7.jpg not downloaded yet
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a6afd0>
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/2.jpg saved to cache
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3dc90>
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/6.jpg saved to cache
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/8.jpg not downloaded yet
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/9.jpg not downloaded yet
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a6b950>
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/5.jpg saved to cache
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd3690>
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/3.jpg saved to cache
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfe090>
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/7.jpg saved to cache
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/10.jpg not downloaded yet
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [ayvens.it] INFO: Found listing with ID: 1989020
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989020%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [ayvens.it] INFO: Scrape type for 1989020: 1
2026-03-27 16:36:21 [ayvens.it] INFO: Extracting data for car ID: 1989020
2026-03-27 16:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ada015c1-09a6-552a-b5ea-eb204dd4bdfa with identifier: 1989020
2026-03-27 16:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa with scrape type 1
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/1.jpg not downloaded yet
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1e190>
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/3.jpg saved to cache
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1c050>
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/1.jpg saved to cache
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/2.jpg not downloaded yet
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/3.jpg not downloaded yet
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/4.jpg not downloaded yet
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69091050>
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/2.jpg saved to cache
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfee10>
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/5.jpg saved to cache
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/5.jpg not downloaded yet
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/6.jpg not downloaded yet
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1cfd0>
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/10.jpg saved to cache
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928ca10>
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/6.jpg saved to cache
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca0a50>
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/9.jpg saved to cache
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928db50>
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/8.jpg saved to cache
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68480d90>
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/4.jpg saved to cache
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/7.jpg not downloaded yet
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/8.jpg not downloaded yet
2026-03-27 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/9.jpg not downloaded yet
2026-03-27 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/10.jpg not downloaded yet
2026-03-27 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:22 [ayvens.it] INFO: Found listing with ID: 1989021
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989021%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [ayvens.it] INFO: Scrape type for 1989021: 1
2026-03-27 16:36:22 [ayvens.it] INFO: Extracting data for car ID: 1989021
2026-03-27 16:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b with identifier: 1989021
2026-03-27 16:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b with scrape type 1
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/1.jpg not downloaded yet
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/2.jpg not downloaded yet
2026-03-27 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/3.jpg not downloaded yet
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e689554d0>
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/3.jpg saved to cache
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934f710>
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/2.jpg saved to cache
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/4.jpg not downloaded yet
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/5.jpg not downloaded yet
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8c1d0>
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/10.jpg saved to cache
2026-03-27 16:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcfd10>
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/1.jpg saved to cache
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0e990>
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/5.jpg saved to cache
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd0590>
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/4.jpg saved to cache
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68608c10>
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/7.jpg saved to cache
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fced50>
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/6.jpg saved to cache
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/6.jpg not downloaded yet
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/7.jpg not downloaded yet
2026-03-27 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/8.jpg not downloaded yet
2026-03-27 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/9.jpg not downloaded yet
2026-03-27 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/10.jpg not downloaded yet
2026-03-27 16:36:23 [ayvens.it] INFO: Found listing with ID: 1989022
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989022%27 HTTP/1.1" 200 None
2026-03-27 16:36:23 [ayvens.it] INFO: Scrape type for 1989022: 1
2026-03-27 16:36:23 [ayvens.it] INFO: Extracting data for car ID: 1989022
2026-03-27 16:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d071df12-1f0f-5247-86f2-3f3b0cfd7bc8 with identifier: 1989022
2026-03-27 16:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8 with scrape type 1
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/1.jpg not downloaded yet
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/2.jpg not downloaded yet
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c54890>
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/3.jpg saved to cache
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c13510>
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/8.jpg saved to cache
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690904d0>
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/2.jpg saved to cache
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c21d90>
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/1.jpg saved to cache
2026-03-27 16:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69280190>
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/9.jpg saved to cache
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/3.jpg not downloaded yet
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/4.jpg not downloaded yet
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b33690>
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/9.jpg saved to cache
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0c150>
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/10.jpg saved to cache
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68eccfd0>
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Feb0fd83a87fe4edab67cbc3e49160daa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/8.jpg saved to cache
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2622d29-41c8-591b-af64-f21f75dba134
2026-03-27 16:36:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2622d29-41c8-591b-af64-f21f75dba134, skipping ID generation
2026-03-27 16:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2622d29-41c8-591b-af64-f21f75dba134 with scrape type 1
2026-03-27 16:36:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2622d29-41c8-591b-af64-f21f75dba134 sending to next pipeline
2026-03-27 16:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c2622d29-41c8-591b-af64-f21f75dba134, identifier: 1989019
2026-03-27 16:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c2622d29-41c8-591b-af64-f21f75dba134 with identifier: 1989019
2026-03-27 16:36:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c2622d29-41c8-591b-af64-f21f75dba134 with identifier: 1989019
2026-03-27 16:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c2622d29-41c8-591b-af64-f21f75dba134 with identifier: 1989019 to the API
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'c2622d29-41c8-591b-af64-f21f75dba134',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 51232,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 73,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794968,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 793051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794968,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 832743,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 803650,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 685948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 721107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2622d29-41c8-591b-af64-f21f75dba134/c2622d29-41c8-591b-af64-f21f75dba134_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698072,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/eb0fd83a87fe4edab67cbc3e49160daa/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989019%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [ayvens.it] INFO: Saving data for 1989019: {'created_time': 1774629385.071833, 'last_price_update_time': 1774629385.071844, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989019') HTTP/1.1" 204 0
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/5.jpg not downloaded yet
2026-03-27 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/6.jpg not downloaded yet
2026-03-27 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2c9d0>
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/8.jpg saved to cache
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/7.jpg not downloaded yet
2026-03-27 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/8.jpg not downloaded yet
2026-03-27 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/9.jpg not downloaded yet
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/10.jpg not downloaded yet
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690ba210>
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/9.jpg saved to cache
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5ba50>
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/7.jpg saved to cache
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:25 [ayvens.it] INFO: Found listing with ID: 1989023
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989023%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [ayvens.it] INFO: Scrape type for 1989023: 1
2026-03-27 16:36:25 [ayvens.it] INFO: Extracting data for car ID: 1989023
2026-03-27 16:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd34f0b6-257a-5a1c-855b-71e732d950b0 with identifier: 1989023
2026-03-27 16:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd34f0b6-257a-5a1c-855b-71e732d950b0 with scrape type 1
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/1.jpg not downloaded yet
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1cfd0>
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/10.jpg saved to cache
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934e510>
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/4.jpg saved to cache
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/2.jpg not downloaded yet
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68613d90>
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/2.jpg saved to cache
2026-03-27 16:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c6dd0>
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/3.jpg saved to cache
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcf890>
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/1.jpg saved to cache
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c42d0>
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/2.jpg saved to cache
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/3.jpg not downloaded yet
2026-03-27 16:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/4.jpg not downloaded yet
2026-03-27 16:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/5.jpg not downloaded yet
2026-03-27 16:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/6.jpg not downloaded yet
2026-03-27 16:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/7.jpg not downloaded yet
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/8.jpg not downloaded yet
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d026d0>
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/9.jpg saved to cache
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/9.jpg not downloaded yet
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/10.jpg not downloaded yet
2026-03-27 16:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:26 [ayvens.it] INFO: Found listing with ID: 1989024
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989024%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [ayvens.it] INFO: Scrape type for 1989024: 1
2026-03-27 16:36:26 [ayvens.it] INFO: Extracting data for car ID: 1989024
2026-03-27 16:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67 with identifier: 1989024
2026-03-27 16:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67 with scrape type 1
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/1.jpg not downloaded yet
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922eed0>
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/7.jpg saved to cache
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1e8d0>
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/6.jpg saved to cache
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc5310>
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/3.jpg saved to cache
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e693b54d0>
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/8.jpg saved to cache
2026-03-27 16:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc7190>
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/10.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68543fd0>
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/1.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/2.jpg not downloaded yet
2026-03-27 16:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/3.jpg not downloaded yet
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e686074d0>
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/4.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69071a10>
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/6.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/4.jpg not downloaded yet
2026-03-27 16:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/5.jpg not downloaded yet
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/6.jpg not downloaded yet
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcdf90>
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/7.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68954e10>
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/5.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f7e10>
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/5.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/7.jpg not downloaded yet
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/8.jpg not downloaded yet
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1cd10>
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/8.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18150>
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/6.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68454a10>
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F5682b0bedf1b4cccac3ca092a845a2e5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/5.jpg saved to cache
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b
2026-03-27 16:36:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b, skipping ID generation
2026-03-27 16:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b with scrape type 1
2026-03-27 16:36:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b sending to next pipeline
2026-03-27 16:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b, identifier: 1989021
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/9.jpg not downloaded yet
2026-03-27 16:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b with identifier: 1989021
2026-03-27 16:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b with identifier: 1989021
2026-03-27 16:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 76a73d26-a8ae-5c82-9fc7-31ca1e8f458b with identifier: 1989021 to the API
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol_lpg',
'id': '76a73d26-a8ae-5c82-9fc7-31ca1e8f458b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP',
'odometer': 96494,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 679309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742663,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570398,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524502,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a73d26-a8ae-5c82-9fc7-31ca1e8f458b/76a73d26-a8ae-5c82-9fc7-31ca1e8f458b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 714296,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/5682b0bedf1b4cccac3ca092a845a2e5/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989021%27 HTTP/1.1" 200 None
2026-03-27 16:36:28 [ayvens.it] INFO: Saving data for 1989021: {'created_time': 1774629388.538103, 'last_price_update_time': 1774629388.538113, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989021') HTTP/1.1" 204 0
2026-03-27 16:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/10.jpg not downloaded yet
2026-03-27 16:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:28 [ayvens.it] INFO: Found listing with ID: 1989025
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989025%27 HTTP/1.1" 200 None
2026-03-27 16:36:28 [ayvens.it] INFO: Scrape type for 1989025: 1
2026-03-27 16:36:28 [ayvens.it] INFO: Extracting data for car ID: 1989025
2026-03-27 16:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa862cbc-d427-5827-89d3-0c1bfd167630 with identifier: 1989025
2026-03-27 16:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa862cbc-d427-5827-89d3-0c1bfd167630 with scrape type 1
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/1.jpg not downloaded yet
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6a710>
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/10.jpg saved to cache
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/2.jpg not downloaded yet
2026-03-27 16:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/3.jpg not downloaded yet
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b2a190>
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/2.jpg saved to cache
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1f0d0>
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/3.jpg saved to cache
2026-03-27 16:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5efd0>
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/5.jpg saved to cache
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916e9d0>
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/4.jpg saved to cache
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/4.jpg not downloaded yet
2026-03-27 16:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/5.jpg not downloaded yet
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/6.jpg not downloaded yet
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690936d0>
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fd9ba7dcc3e974ea9b2a869b7c7eb1331%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/4.jpg saved to cache
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa
2026-03-27 16:36:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ada015c1-09a6-552a-b5ea-eb204dd4bdfa, skipping ID generation
2026-03-27 16:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa with scrape type 1
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ada015c1-09a6-552a-b5ea-eb204dd4bdfa sending to next pipeline
2026-03-27 16:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ada015c1-09a6-552a-b5ea-eb204dd4bdfa, identifier: 1989020
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6941a910>
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv3%252F6dbf2bfbb2cd4871b614040079e224eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/9.jpg saved to cache
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8
2026-03-27 16:36:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d071df12-1f0f-5247-86f2-3f3b0cfd7bc8, skipping ID generation
2026-03-27 16:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8 with scrape type 1
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d071df12-1f0f-5247-86f2-3f3b0cfd7bc8 sending to next pipeline
2026-03-27 16:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d071df12-1f0f-5247-86f2-3f3b0cfd7bc8, identifier: 1989022
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8e050>
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/1.jpg saved to cache
2026-03-27 16:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ada015c1-09a6-552a-b5ea-eb204dd4bdfa with identifier: 1989020
2026-03-27 16:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ada015c1-09a6-552a-b5ea-eb204dd4bdfa with identifier: 1989020
2026-03-27 16:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ada015c1-09a6-552a-b5ea-eb204dd4bdfa with identifier: 1989020 to the API
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol_lpg',
'id': 'ada015c1-09a6-552a-b5ea-eb204dd4bdfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP',
'odometer': 87305,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599081,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535904,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251330,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521557,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada015c1-09a6-552a-b5ea-eb204dd4bdfa/ada015c1-09a6-552a-b5ea-eb204dd4bdfa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604486,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/d9ba7dcc3e974ea9b2a869b7c7eb1331/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989020%27 HTTP/1.1" 200 None
2026-03-27 16:36:29 [ayvens.it] INFO: Saving data for 1989020: {'created_time': 1774629389.927246, 'last_price_update_time': 1774629389.927256, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989020') HTTP/1.1" 204 0
2026-03-27 16:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d071df12-1f0f-5247-86f2-3f3b0cfd7bc8 with identifier: 1989022
2026-03-27 16:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d071df12-1f0f-5247-86f2-3f3b0cfd7bc8 with identifier: 1989022
2026-03-27 16:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d071df12-1f0f-5247-86f2-3f3b0cfd7bc8 with identifier: 1989022 to the API
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'd071df12-1f0f-5247-86f2-3f3b0cfd7bc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP',
'odometer': 130369,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 793944,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438070,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 761184,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494387,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711839,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384690,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632464,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 732517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d071df12-1f0f-5247-86f2-3f3b0cfd7bc8/d071df12-1f0f-5247-86f2-3f3b0cfd7bc8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632826,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv3/6dbf2bfbb2cd4871b614040079e224eb/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-06',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989022%27 HTTP/1.1" 200 None
2026-03-27 16:36:30 [ayvens.it] INFO: Saving data for 1989022: {'created_time': 1774629390.378328, 'last_price_update_time': 1774629390.378338, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989022') HTTP/1.1" 204 0
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/7.jpg not downloaded yet
2026-03-27 16:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/8.jpg not downloaded yet
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcf590>
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/9.jpg saved to cache
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/9.jpg not downloaded yet
2026-03-27 16:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/10.jpg not downloaded yet
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a69990>
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/10.jpg saved to cache
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:30 [ayvens.it] INFO: Found listing with ID: 1989026
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989026%27 HTTP/1.1" 200 None
2026-03-27 16:36:30 [ayvens.it] INFO: Scrape type for 1989026: 1
2026-03-27 16:36:30 [ayvens.it] INFO: Extracting data for car ID: 1989026
2026-03-27 16:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3534b04-592c-5e8b-b8c9-fb5c888da132 with identifier: 1989026
2026-03-27 16:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3534b04-592c-5e8b-b8c9-fb5c888da132 with scrape type 1
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/1.jpg not downloaded yet
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/2.jpg not downloaded yet
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68540f10>
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/1.jpg saved to cache
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922dd10>
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/4.jpg saved to cache
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc5ad0>
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/8.jpg saved to cache
2026-03-27 16:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690f3450>
2026-03-27 16:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/2.jpg saved to cache
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd77d0>
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/7.jpg saved to cache
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6901bfd0>
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/3.jpg saved to cache
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/3.jpg not downloaded yet
2026-03-27 16:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/4.jpg not downloaded yet
2026-03-27 16:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/5.jpg not downloaded yet
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/6.jpg not downloaded yet
2026-03-27 16:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/7.jpg not downloaded yet
2026-03-27 16:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/8.jpg not downloaded yet
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/9.jpg not downloaded yet
2026-03-27 16:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2f9d0>
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/6.jpg saved to cache
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/10.jpg not downloaded yet
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e698eac10>
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/8.jpg saved to cache
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a58590>
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/9.jpg saved to cache
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69093ed0>
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/10.jpg saved to cache
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:31 [ayvens.it] INFO: Found listing with ID: 1989027
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989027%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [ayvens.it] INFO: Scrape type for 1989027: 1
2026-03-27 16:36:31 [ayvens.it] INFO: Extracting data for car ID: 1989027
2026-03-27 16:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2976a72-015c-541b-838a-2bb991e3f666 with identifier: 1989027
2026-03-27 16:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2976a72-015c-541b-838a-2bb991e3f666 with scrape type 1
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/1.jpg not downloaded yet
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/2.jpg not downloaded yet
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6b290>
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/4.jpg saved to cache
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c7bd50>
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/7.jpg saved to cache
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69342110>
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/1.jpg saved to cache
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68955790>
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/3.jpg saved to cache
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/3.jpg not downloaded yet
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/4.jpg not downloaded yet
2026-03-27 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/5.jpg not downloaded yet
2026-03-27 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/6.jpg not downloaded yet
2026-03-27 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/7.jpg not downloaded yet
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/8.jpg not downloaded yet
2026-03-27 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/9.jpg not downloaded yet
2026-03-27 16:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/10.jpg not downloaded yet
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c100d0>
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/8.jpg saved to cache
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68546dd0>
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/7.jpg saved to cache
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b33650>
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/6.jpg saved to cache
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:32 [ayvens.it] INFO: Found listing with ID: 1989028
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989028%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [ayvens.it] INFO: Scrape type for 1989028: 1
2026-03-27 16:36:32 [ayvens.it] INFO: Extracting data for car ID: 1989028
2026-03-27 16:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c9aa27c-229c-58e2-a81f-2b969c532067 with identifier: 1989028
2026-03-27 16:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c9aa27c-229c-58e2-a81f-2b969c532067 with scrape type 1
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/1.jpg not downloaded yet
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c9310>
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/10.jpg saved to cache
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c20510>
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/2.jpg saved to cache
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/2.jpg not downloaded yet
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/3.jpg not downloaded yet
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c35090>
2026-03-27 16:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/9.jpg saved to cache
2026-03-27 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69161210>
2026-03-27 16:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf7%252F9c351795035b47f993ea368b10209917%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/5.jpg saved to cache
2026-03-27 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa862cbc-d427-5827-89d3-0c1bfd167630
2026-03-27 16:36:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa862cbc-d427-5827-89d3-0c1bfd167630, skipping ID generation
2026-03-27 16:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa862cbc-d427-5827-89d3-0c1bfd167630 with scrape type 1
2026-03-27 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa862cbc-d427-5827-89d3-0c1bfd167630 sending to next pipeline
2026-03-27 16:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fa862cbc-d427-5827-89d3-0c1bfd167630, identifier: 1989025
2026-03-27 16:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684819d0>
2026-03-27 16:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn9%252Ff7e796cdb5b440a6a96b360f8c461489%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/5.jpg saved to cache
2026-03-27 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67
2026-03-27 16:36:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67, skipping ID generation
2026-03-27 16:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67 with scrape type 1
2026-03-27 16:36:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67 sending to next pipeline
2026-03-27 16:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67, identifier: 1989024
2026-03-27 16:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fa862cbc-d427-5827-89d3-0c1bfd167630 with identifier: 1989025
2026-03-27 16:36:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fa862cbc-d427-5827-89d3-0c1bfd167630 with identifier: 1989025
2026-03-27 16:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fa862cbc-d427-5827-89d3-0c1bfd167630 with identifier: 1989025 to the API
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio Urano pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'fa862cbc-d427-5827-89d3-0c1bfd167630',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Life DSG Hatchback 5-door '
'(Euro 6.2) mild hybrid',
'odometer': 185156,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 845432,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 837401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695623,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa862cbc-d427-5827-89d3-0c1bfd167630/fa862cbc-d427-5827-89d3-0c1bfd167630_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf7/9c351795035b47f993ea368b10209917/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-08',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 1.5 eTSI EVO ACT 96kW Life DSG Hatchback '
'5-door (Euro 6.2) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989025%27 HTTP/1.1" 200 None
2026-03-27 16:36:33 [ayvens.it] INFO: Saving data for 1989025: {'created_time': 1774629393.944145, 'last_price_update_time': 1774629393.944156, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989025') HTTP/1.1" 204 0
2026-03-27 16:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67 with identifier: 1989024
2026-03-27 16:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67 with identifier: 1989024
2026-03-27 16:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5bc0b3db-ecdc-5ec9-8037-0cc03619fc67 with identifier: 1989024 to the API
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '5bc0b3db-ecdc-5ec9-8037-0cc03619fc67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 62986,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 804766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613184,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 851785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 863022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669961,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686945,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc0b3db-ecdc-5ec9-8037-0cc03619fc67/5bc0b3db-ecdc-5ec9-8037-0cc03619fc67_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 804766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn9/f7e796cdb5b440a6a96b360f8c461489/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989024%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [ayvens.it] INFO: Saving data for 1989024: {'created_time': 1774629394.370705, 'last_price_update_time': 1774629394.370715, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989024') HTTP/1.1" 204 0
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/4.jpg not downloaded yet
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/5.jpg not downloaded yet
2026-03-27 16:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/6.jpg not downloaded yet
2026-03-27 16:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/7.jpg not downloaded yet
2026-03-27 16:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/8.jpg not downloaded yet
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/9.jpg not downloaded yet
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/10.jpg not downloaded yet
2026-03-27 16:36:34 [ayvens.it] INFO: Found listing with ID: 1989029
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989029%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [ayvens.it] INFO: Scrape type for 1989029: 1
2026-03-27 16:36:34 [ayvens.it] INFO: Extracting data for car ID: 1989029
2026-03-27 16:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22c3f75d-c6c4-5a13-92df-171229b016c2 with identifier: 1989029
2026-03-27 16:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c3f75d-c6c4-5a13-92df-171229b016c2 with scrape type 1
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/1.jpg not downloaded yet
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/2.jpg not downloaded yet
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922cd50>
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/10.jpg saved to cache
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfeed0>
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/7.jpg saved to cache
2026-03-27 16:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fe83d0>
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/1.jpg saved to cache
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd0810>
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/8.jpg saved to cache
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9a310>
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/9.jpg saved to cache
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fea450>
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/4.jpg saved to cache
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/3.jpg not downloaded yet
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9b510>
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/3.jpg saved to cache
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6901bb50>
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/5.jpg saved to cache
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/4.jpg not downloaded yet
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/5.jpg not downloaded yet
2026-03-27 16:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/6.jpg not downloaded yet
2026-03-27 16:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/7.jpg not downloaded yet
2026-03-27 16:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/8.jpg not downloaded yet
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/9.jpg not downloaded yet
2026-03-27 16:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/10.jpg not downloaded yet
2026-03-27 16:36:35 [ayvens.it] INFO: Found listing with ID: 1989030
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989030%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [ayvens.it] INFO: Scrape type for 1989030: 1
2026-03-27 16:36:35 [ayvens.it] INFO: Extracting data for car ID: 1989030
2026-03-27 16:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d33a63c-5c27-5117-81af-a392228755c1 with identifier: 1989030
2026-03-27 16:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d33a63c-5c27-5117-81af-a392228755c1 with scrape type 1
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/1.jpg not downloaded yet
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/2.jpg not downloaded yet
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916f5d0>
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/10.jpg saved to cache
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f7d90>
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/3.jpg saved to cache
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccfb90>
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/5.jpg saved to cache
2026-03-27 16:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b02210>
2026-03-27 16:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/6.jpg saved to cache
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfc7d0>
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/2.jpg saved to cache
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/3.jpg not downloaded yet
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a7de90>
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/6.jpg saved to cache
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb7b50>
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/4.jpg saved to cache
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/4.jpg not downloaded yet
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/5.jpg not downloaded yet
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bcebd0>
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/1.jpg saved to cache
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/6.jpg not downloaded yet
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/7.jpg not downloaded yet
2026-03-27 16:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/8.jpg not downloaded yet
2026-03-27 16:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/9.jpg not downloaded yet
2026-03-27 16:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/10.jpg not downloaded yet
2026-03-27 16:36:36 [ayvens.it] INFO: Found listing with ID: 1989031
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989031%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [ayvens.it] INFO: Scrape type for 1989031: 1
2026-03-27 16:36:36 [ayvens.it] INFO: Extracting data for car ID: 1989031
2026-03-27 16:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a072bbe-6690-57a1-a977-08ca5a88eaf1 with identifier: 1989031
2026-03-27 16:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1 with scrape type 1
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/1.jpg not downloaded yet
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/2.jpg not downloaded yet
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/3.jpg not downloaded yet
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692f9310>
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/4.jpg saved to cache
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cccad0>
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/9.jpg saved to cache
2026-03-27 16:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1d590>
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/3.jpg saved to cache
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccf690>
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/2.jpg saved to cache
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916f310>
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/1.jpg saved to cache
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/4.jpg not downloaded yet
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/5.jpg not downloaded yet
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68607050>
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/3.jpg saved to cache
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922eb90>
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/2.jpg saved to cache
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0c090>
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/5.jpg saved to cache
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/6.jpg not downloaded yet
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/7.jpg not downloaded yet
2026-03-27 16:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/8.jpg not downloaded yet
2026-03-27 16:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/9.jpg not downloaded yet
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/10.jpg not downloaded yet
2026-03-27 16:36:37 [ayvens.it] INFO: Found listing with ID: 1989032
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989032%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [ayvens.it] INFO: Scrape type for 1989032: 1
2026-03-27 16:36:37 [ayvens.it] INFO: Extracting data for car ID: 1989032
2026-03-27 16:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e1272b5-08ed-5e0e-a80e-6892c6ac788e with identifier: 1989032
2026-03-27 16:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e with scrape type 1
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/1.jpg not downloaded yet
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/2.jpg not downloaded yet
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922da10>
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/7.jpg saved to cache
2026-03-27 16:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d22190>
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/6.jpg saved to cache
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f9a90>
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/3.jpg saved to cache
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c87890>
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/10.jpg saved to cache
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d23410>
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/9.jpg saved to cache
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d20d10>
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/4.jpg saved to cache
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835cfd0>
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/8.jpg saved to cache
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/3.jpg not downloaded yet
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b184d0>
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/5.jpg saved to cache
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/4.jpg not downloaded yet
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/5.jpg not downloaded yet
2026-03-27 16:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/6.jpg not downloaded yet
2026-03-27 16:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/7.jpg not downloaded yet
2026-03-27 16:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/8.jpg not downloaded yet
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/9.jpg not downloaded yet
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/10.jpg not downloaded yet
2026-03-27 16:36:38 [ayvens.it] INFO: Found listing with ID: 1989033
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989033%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [ayvens.it] INFO: Scrape type for 1989033: 1
2026-03-27 16:36:38 [ayvens.it] INFO: Extracting data for car ID: 1989033
2026-03-27 16:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f998d079-ec3b-5c82-98dd-d21e59ea6fbd with identifier: 1989033
2026-03-27 16:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd with scrape type 1
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/1.jpg not downloaded yet
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692359d0>
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/6.jpg saved to cache
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/2.jpg not downloaded yet
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691608d0>
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/4.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69368f50>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/2.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b81490>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/2.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69516d50>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/3.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68acc6d0>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/7.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69369b50>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/5.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fcf050>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/4.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/3.jpg not downloaded yet
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/4.jpg not downloaded yet
2026-03-27 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/5.jpg not downloaded yet
2026-03-27 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/6.jpg not downloaded yet
2026-03-27 16:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/7.jpg not downloaded yet
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/8.jpg not downloaded yet
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/9.jpg not downloaded yet
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/10.jpg not downloaded yet
2026-03-27 16:36:39 [ayvens.it] INFO: Found listing with ID: 1989034
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989034%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [ayvens.it] INFO: Scrape type for 1989034: 1
2026-03-27 16:36:39 [ayvens.it] INFO: Extracting data for car ID: 1989034
2026-03-27 16:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a32798c-e97d-5414-88b4-cf4e856b4599 with identifier: 1989034
2026-03-27 16:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a32798c-e97d-5414-88b4-cf4e856b4599 with scrape type 1
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/1.jpg not downloaded yet
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b18c90>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/3.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/2.jpg not downloaded yet
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fca510>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/1.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69234ed0>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/1.jpg saved to cache
2026-03-27 16:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68611110>
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/2.jpg saved to cache
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e7721a6d0>
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/7.jpg saved to cache
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c68cd0>
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/10.jpg saved to cache
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6928ead0>
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/5.jpg saved to cache
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69489ed0>
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/6.jpg saved to cache
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/3.jpg not downloaded yet
2026-03-27 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/4.jpg not downloaded yet
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/5.jpg not downloaded yet
2026-03-27 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/6.jpg not downloaded yet
2026-03-27 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/7.jpg not downloaded yet
2026-03-27 16:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/8.jpg not downloaded yet
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/9.jpg not downloaded yet
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1e990>
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/6.jpg saved to cache
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/10.jpg not downloaded yet
2026-03-27 16:36:40 [ayvens.it] INFO: Found listing with ID: 1989035
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989035%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [ayvens.it] INFO: Scrape type for 1989035: 1
2026-03-27 16:36:40 [ayvens.it] INFO: Extracting data for car ID: 1989035
2026-03-27 16:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff930335-307e-5350-b6d2-3efd9b26c642 with identifier: 1989035
2026-03-27 16:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff930335-307e-5350-b6d2-3efd9b26c642 with scrape type 1
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/1.jpg not downloaded yet
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/2.jpg not downloaded yet
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c54dd0>
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/9.jpg saved to cache
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934ce50>
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/7.jpg saved to cache
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922cdd0>
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/5.jpg saved to cache
2026-03-27 16:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6934e090>
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/10.jpg saved to cache
2026-03-27 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694897d0>
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/4.jpg saved to cache
2026-03-27 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68613f50>
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp1%252Fa72669f4c1b44bf7b73f03b39b2a7496%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/8.jpg saved to cache
2026-03-27 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1
2026-03-27 16:36:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a072bbe-6690-57a1-a977-08ca5a88eaf1, skipping ID generation
2026-03-27 16:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1 with scrape type 1
2026-03-27 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a072bbe-6690-57a1-a977-08ca5a88eaf1 sending to next pipeline
2026-03-27 16:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0a072bbe-6690-57a1-a977-08ca5a88eaf1, identifier: 1989031
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b215d0>
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/9.jpg saved to cache
2026-03-27 16:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0a072bbe-6690-57a1-a977-08ca5a88eaf1 with identifier: 1989031
2026-03-27 16:36:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0a072bbe-6690-57a1-a977-08ca5a88eaf1 with identifier: 1989031
2026-03-27 16:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0a072bbe-6690-57a1-a977-08ca5a88eaf1 with identifier: 1989031 to the API
2026-03-27 16:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ONYX BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '0a072bbe-6690-57a1-a977-08ca5a88eaf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 B4 D automatico Core Sport utility vehicle 5-door (Euro '
'6D)',
'odometer': 18240,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556614,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558176,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a072bbe-6690-57a1-a977-08ca5a88eaf1/0a072bbe-6690-57a1-a977-08ca5a88eaf1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp1/a72669f4c1b44bf7b73f03b39b2a7496/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 B4 D automatico Core Sport utility vehicle 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989031%27 HTTP/1.1" 200 None
2026-03-27 16:36:42 [ayvens.it] INFO: Saving data for 1989031: {'created_time': 1774629402.948107, 'last_price_update_time': 1774629402.948123, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989031') HTTP/1.1" 204 0
2026-03-27 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/3.jpg not downloaded yet
2026-03-27 16:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/4.jpg not downloaded yet
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e786e4050>
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/10.jpg saved to cache
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/5.jpg not downloaded yet
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/6.jpg not downloaded yet
2026-03-27 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/7.jpg not downloaded yet
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68540090>
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/9.jpg saved to cache
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/8.jpg not downloaded yet
2026-03-27 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/9.jpg not downloaded yet
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68adf410>
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp3%252Fe98514412cc8411bb9c2bf89bb4dfa85%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/8.jpg saved to cache
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e
2026-03-27 16:36:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e1272b5-08ed-5e0e-a80e-6892c6ac788e, skipping ID generation
2026-03-27 16:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e with scrape type 1
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e1272b5-08ed-5e0e-a80e-6892c6ac788e sending to next pipeline
2026-03-27 16:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9e1272b5-08ed-5e0e-a80e-6892c6ac788e, identifier: 1989032
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc4b10>
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/1.jpg saved to cache
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/10.jpg not downloaded yet
2026-03-27 16:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9e1272b5-08ed-5e0e-a80e-6892c6ac788e with identifier: 1989032
2026-03-27 16:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9e1272b5-08ed-5e0e-a80e-6892c6ac788e with identifier: 1989032
2026-03-27 16:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9e1272b5-08ed-5e0e-a80e-6892c6ac788e with identifier: 1989032 to the API
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO BRILLANTE',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '9e1272b5-08ed-5e0e-a80e-6892c6ac788e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA 2.0 TDI EVO 110KW EXECUTIVE DSG FP',
'odometer': 125681,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e1272b5-08ed-5e0e-a80e-6892c6ac788e/9e1272b5-08ed-5e0e-a80e-6892c6ac788e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp3/e98514412cc8411bb9c2bf89bb4dfa85/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA 2.0 TDI EVO 110KW EXECUTIVE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989032%27 HTTP/1.1" 200 None
2026-03-27 16:36:43 [ayvens.it] INFO: Saving data for 1989032: {'created_time': 1774629403.94225, 'last_price_update_time': 1774629403.942262, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989032') HTTP/1.1" 204 0
2026-03-27 16:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:43 [ayvens.it] INFO: Found listing with ID: 1989036
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989036%27 HTTP/1.1" 200 None
2026-03-27 16:36:43 [ayvens.it] INFO: Scrape type for 1989036: 1
2026-03-27 16:36:43 [ayvens.it] INFO: Extracting data for car ID: 1989036
2026-03-27 16:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 007368f6-660a-5b92-9e1e-2d8af08a9ecc with identifier: 1989036
2026-03-27 16:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc with scrape type 1
2026-03-27 16:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/1.jpg not downloaded yet
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/2.jpg not downloaded yet
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69029490>
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/2.jpg saved to cache
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69408690>
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/3.jpg saved to cache
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bda910>
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/5.jpg saved to cache
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfd410>
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/4.jpg saved to cache
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fd1190>
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/4.jpg saved to cache
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/3.jpg not downloaded yet
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/4.jpg not downloaded yet
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68faf390>
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/3.jpg saved to cache
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/5.jpg not downloaded yet
2026-03-27 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/6.jpg not downloaded yet
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/7.jpg not downloaded yet
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd6110>
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/2.jpg saved to cache
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/8.jpg not downloaded yet
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/9.jpg not downloaded yet
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f9abd0>
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/5.jpg saved to cache
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692de810>
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/1.jpg saved to cache
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e59d0>
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/9.jpg saved to cache
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69046a90>
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/10.jpg saved to cache
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b56f90>
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/6.jpg saved to cache
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/10.jpg not downloaded yet
2026-03-27 16:36:45 [ayvens.it] INFO: Found listing with ID: 1989037
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989037%27 HTTP/1.1" 200 None
2026-03-27 16:36:45 [ayvens.it] INFO: Scrape type for 1989037: 1
2026-03-27 16:36:45 [ayvens.it] INFO: Extracting data for car ID: 1989037
2026-03-27 16:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643e4064-cf92-549c-bf5c-480cecac0cce with identifier: 1989037
2026-03-27 16:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643e4064-cf92-549c-bf5c-480cecac0cce with scrape type 1
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/1.jpg not downloaded yet
2026-03-27 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/2.jpg not downloaded yet
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916d550>
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/1.jpg saved to cache
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bb7890>
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/3.jpg saved to cache
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/3.jpg not downloaded yet
2026-03-27 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/4.jpg not downloaded yet
2026-03-27 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b66e10>
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/4.jpg saved to cache
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/5.jpg not downloaded yet
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/6.jpg not downloaded yet
2026-03-27 16:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/7.jpg not downloaded yet
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916f610>
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/7.jpg saved to cache
2026-03-27 16:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68955c10>
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/6.jpg saved to cache
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ec290>
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/5.jpg saved to cache
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c87990>
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/2.jpg saved to cache
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/8.jpg not downloaded yet
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69300ed0>
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/2.jpg saved to cache
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cf8250>
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/10.jpg saved to cache
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/9.jpg not downloaded yet
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b88650>
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/1.jpg saved to cache
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/10.jpg not downloaded yet
2026-03-27 16:36:46 [ayvens.it] INFO: Found listing with ID: 1989038
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989038%27 HTTP/1.1" 200 None
2026-03-27 16:36:46 [ayvens.it] INFO: Scrape type for 1989038: 1
2026-03-27 16:36:46 [ayvens.it] INFO: Extracting data for car ID: 1989038
2026-03-27 16:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d8a2d91-364b-538d-afa1-130aa588e53b with identifier: 1989038
2026-03-27 16:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d8a2d91-364b-538d-afa1-130aa588e53b with scrape type 1
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/1.jpg not downloaded yet
2026-03-27 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/2.jpg not downloaded yet
2026-03-27 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/3.jpg not downloaded yet
2026-03-27 16:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/4.jpg not downloaded yet
2026-03-27 16:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/5.jpg not downloaded yet
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/6.jpg not downloaded yet
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/7.jpg not downloaded yet
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/8.jpg not downloaded yet
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccfe90>
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/10.jpg saved to cache
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af6590>
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/7.jpg saved to cache
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b67610>
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/8.jpg saved to cache
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68af5510>
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/4.jpg saved to cache
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1e190>
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/5.jpg saved to cache
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/9.jpg not downloaded yet
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1cf90>
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/3.jpg saved to cache
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690b4b10>
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs1%252F70ca3e5525f046d6b5dc4a492fa2f561%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/9.jpg saved to cache
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff930335-307e-5350-b6d2-3efd9b26c642
2026-03-27 16:36:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff930335-307e-5350-b6d2-3efd9b26c642, skipping ID generation
2026-03-27 16:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff930335-307e-5350-b6d2-3efd9b26c642 with scrape type 1
2026-03-27 16:36:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff930335-307e-5350-b6d2-3efd9b26c642 sending to next pipeline
2026-03-27 16:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ff930335-307e-5350-b6d2-3efd9b26c642, identifier: 1989035
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/10.jpg not downloaded yet
2026-03-27 16:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ff930335-307e-5350-b6d2-3efd9b26c642 with identifier: 1989035
2026-03-27 16:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ff930335-307e-5350-b6d2-3efd9b26c642 with identifier: 1989035
2026-03-27 16:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ff930335-307e-5350-b6d2-3efd9b26c642 with identifier: 1989035 to the API
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU NAVARRA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'ff930335-307e-5350-b6d2-3efd9b26c642',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 45 TFSI e S tronic Business Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 36581,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 565661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443141,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff930335-307e-5350-b6d2-3efd9b26c642/ff930335-307e-5350-b6d2-3efd9b26c642_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569421,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs1/70ca3e5525f046d6b5dc4a492fa2f561/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 45 TFSI e S tronic Business Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989035%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [ayvens.it] INFO: Saving data for 1989035: {'created_time': 1774629408.653031, 'last_price_update_time': 1774629408.653041, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989035') HTTP/1.1" 204 0
2026-03-27 16:36:48 [ayvens.it] INFO: Found listing with ID: 1989039
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989039%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [ayvens.it] INFO: Scrape type for 1989039: 1
2026-03-27 16:36:48 [ayvens.it] INFO: Extracting data for car ID: 1989039
2026-03-27 16:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32732ab0-9da5-50bd-be8b-353261455ef9 with identifier: 1989039
2026-03-27 16:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32732ab0-9da5-50bd-be8b-353261455ef9 with scrape type 1
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/1.jpg not downloaded yet
2026-03-27 16:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6835f150>
2026-03-27 16:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/6.jpg saved to cache
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/2.jpg not downloaded yet
2026-03-27 16:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/3.jpg not downloaded yet
2026-03-27 16:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/4.jpg not downloaded yet
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/5.jpg not downloaded yet
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/6.jpg not downloaded yet
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/7.jpg not downloaded yet
2026-03-27 16:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69368290>
2026-03-27 16:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/10.jpg saved to cache
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6940a250>
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/9.jpg saved to cache
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/8.jpg not downloaded yet
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b81310>
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/9.jpg saved to cache
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/9.jpg not downloaded yet
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/10.jpg not downloaded yet
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69454510>
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr4%252Fdc7a206bd447462abc435fed4b557839%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/8.jpg saved to cache
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc
2026-03-27 16:36:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 007368f6-660a-5b92-9e1e-2d8af08a9ecc, skipping ID generation
2026-03-27 16:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc with scrape type 1
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 007368f6-660a-5b92-9e1e-2d8af08a9ecc sending to next pipeline
2026-03-27 16:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 007368f6-660a-5b92-9e1e-2d8af08a9ecc, identifier: 1989036
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bd8550>
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/1.jpg saved to cache
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b30850>
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/3.jpg saved to cache
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feb910>
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/2.jpg saved to cache
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b82950>
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/6.jpg saved to cache
2026-03-27 16:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 007368f6-660a-5b92-9e1e-2d8af08a9ecc with identifier: 1989036
2026-03-27 16:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 007368f6-660a-5b92-9e1e-2d8af08a9ecc with identifier: 1989036
2026-03-27 16:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 007368f6-660a-5b92-9e1e-2d8af08a9ecc with identifier: 1989036 to the API
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ONYX BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '007368f6-660a-5b92-9e1e-2d8af08a9ecc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 B3 AUTOMATICO CORE FP',
'odometer': 39835,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 59,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749990,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 808211,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551982,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_007368f6-660a-5b92-9e1e-2d8af08a9ecc/007368f6-660a-5b92-9e1e-2d8af08a9ecc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630857,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr4/dc7a206bd447462abc435fed4b557839/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 B3 AUTOMATICO CORE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989036%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [ayvens.it] INFO: Saving data for 1989036: {'created_time': 1774629410.091567, 'last_price_update_time': 1774629410.091579, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989036') HTTP/1.1" 204 0
2026-03-27 16:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:50 [ayvens.it] INFO: Found listing with ID: 1989040
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989040%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [ayvens.it] INFO: Scrape type for 1989040: 1
2026-03-27 16:36:50 [ayvens.it] INFO: Extracting data for car ID: 1989040
2026-03-27 16:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76173b2c-f395-5fdd-88c2-466149774d27 with identifier: 1989040
2026-03-27 16:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76173b2c-f395-5fdd-88c2-466149774d27 with scrape type 1
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/1.jpg not downloaded yet
2026-03-27 16:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/2.jpg not downloaded yet
2026-03-27 16:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/3.jpg not downloaded yet
2026-03-27 16:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/4.jpg not downloaded yet
2026-03-27 16:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/5.jpg not downloaded yet
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69091a10>
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/7.jpg saved to cache
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/6.jpg not downloaded yet
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/7.jpg not downloaded yet
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/8.jpg not downloaded yet
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba9b90>
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/10.jpg saved to cache
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925d490>
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/8.jpg saved to cache
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68520cd0>
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/9.jpg saved to cache
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecedd0>
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/5.jpg saved to cache
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68522890>
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/9.jpg saved to cache
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc44d0>
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/2.jpg saved to cache
2026-03-27 16:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ecee90>
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/1.jpg saved to cache
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/9.jpg not downloaded yet
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/10.jpg not downloaded yet
2026-03-27 16:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:51 [ayvens.it] INFO: Found listing with ID: 1989041
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989041%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [ayvens.it] INFO: Scrape type for 1989041: 1
2026-03-27 16:36:51 [ayvens.it] INFO: Extracting data for car ID: 1989041
2026-03-27 16:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47f549ab-bd39-5a99-a8d6-5518ebda49f1 with identifier: 1989041
2026-03-27 16:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1 with scrape type 1
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/1.jpg not downloaded yet
2026-03-27 16:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/2.jpg not downloaded yet
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/3.jpg not downloaded yet
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/4.jpg not downloaded yet
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/5.jpg not downloaded yet
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/6.jpg not downloaded yet
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c99a50>
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/8.jpg saved to cache
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feb350>
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/8.jpg saved to cache
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fec110>
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/6.jpg saved to cache
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fae5d0>
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/7.jpg saved to cache
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/7.jpg not downloaded yet
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/8.jpg not downloaded yet
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/9.jpg not downloaded yet
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68457d10>
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/7.jpg saved to cache
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cd5e10>
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/10.jpg saved to cache
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68483c50>
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/1.jpg saved to cache
2026-03-27 16:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e686059d0>
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/2.jpg saved to cache
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/10.jpg not downloaded yet
2026-03-27 16:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:52 [ayvens.it] INFO: Found listing with ID: 1989042
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989042%27 HTTP/1.1" 200 None
2026-03-27 16:36:52 [ayvens.it] INFO: Scrape type for 1989042: 1
2026-03-27 16:36:52 [ayvens.it] INFO: Extracting data for car ID: 1989042
2026-03-27 16:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc with identifier: 1989042
2026-03-27 16:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc with scrape type 1
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/1.jpg not downloaded yet
2026-03-27 16:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/2.jpg not downloaded yet
2026-03-27 16:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/3.jpg not downloaded yet
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bfd850>
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/1.jpg saved to cache
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/4.jpg not downloaded yet
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/5.jpg not downloaded yet
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6916efd0>
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/10.jpg saved to cache
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bab050>
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/2.jpg saved to cache
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0e050>
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/6.jpg saved to cache
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912ea90>
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/7.jpg saved to cache
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5fc10>
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/9.jpg saved to cache
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba84d0>
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/8.jpg saved to cache
2026-03-27 16:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0fed0>
2026-03-27 16:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/5.jpg saved to cache
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/6.jpg not downloaded yet
2026-03-27 16:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/7.jpg not downloaded yet
2026-03-27 16:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/8.jpg not downloaded yet
2026-03-27 16:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/9.jpg not downloaded yet
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/10.jpg not downloaded yet
2026-03-27 16:36:53 [ayvens.it] INFO: Found listing with ID: 1989043
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989043%27 HTTP/1.1" 200 None
2026-03-27 16:36:53 [ayvens.it] INFO: Scrape type for 1989043: 1
2026-03-27 16:36:53 [ayvens.it] INFO: Extracting data for car ID: 1989043
2026-03-27 16:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddd94fe0-587b-55b9-b4ba-3943a76d00d9 with identifier: 1989043
2026-03-27 16:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9 with scrape type 1
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/1.jpg not downloaded yet
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/2.jpg not downloaded yet
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923c710>
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/9.jpg saved to cache
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc8910>
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/6.jpg saved to cache
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b65910>
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/6.jpg saved to cache
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c0abd0>
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/4.jpg saved to cache
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fc9ed0>
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/5.jpg saved to cache
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b4b750>
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/3.jpg saved to cache
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6ae90>
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/7.jpg saved to cache
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6967ccd0>
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fc76fa38989114af98717b3673f82443e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/10.jpg saved to cache
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76173b2c-f395-5fdd-88c2-466149774d27
2026-03-27 16:36:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76173b2c-f395-5fdd-88c2-466149774d27, skipping ID generation
2026-03-27 16:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76173b2c-f395-5fdd-88c2-466149774d27 with scrape type 1
2026-03-27 16:36:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76173b2c-f395-5fdd-88c2-466149774d27 sending to next pipeline
2026-03-27 16:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 76173b2c-f395-5fdd-88c2-466149774d27, identifier: 1989040
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/3.jpg not downloaded yet
2026-03-27 16:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 76173b2c-f395-5fdd-88c2-466149774d27 with identifier: 1989040
2026-03-27 16:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 76173b2c-f395-5fdd-88c2-466149774d27 with identifier: 1989040
2026-03-27 16:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 76173b2c-f395-5fdd-88c2-466149774d27 with identifier: 1989040 to the API
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '76173b2c-f395-5fdd-88c2-466149774d27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 (PC) 1.0 70CV IBRIDO CLUB FP',
'odometer': 50722,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554846,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76173b2c-f395-5fdd-88c2-466149774d27/76173b2c-f395-5fdd-88c2-466149774d27_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/c76fa38989114af98717b3673f82443e/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 (PC) 1.0 70CV IBRIDO CLUB FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989040%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [ayvens.it] INFO: Saving data for 1989040: {'created_time': 1774629414.619515, 'last_price_update_time': 1774629414.619526, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989040') HTTP/1.1" 204 0
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/4.jpg not downloaded yet
2026-03-27 16:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/5.jpg not downloaded yet
2026-03-27 16:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/6.jpg not downloaded yet
2026-03-27 16:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/7.jpg not downloaded yet
2026-03-27 16:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/8.jpg not downloaded yet
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/9.jpg not downloaded yet
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/10.jpg not downloaded yet
2026-03-27 16:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69426cd0>
2026-03-27 16:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/8.jpg saved to cache
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:54 [ayvens.it] INFO: Found listing with ID: 1984677
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984677%27 HTTP/1.1" 200 None
2026-03-27 16:36:54 [ayvens.it] INFO: Scrape type for 1984677: 2
2026-03-27 16:36:54 [ayvens.it] INFO: Extracting data for car ID: 1984677
2026-03-27 16:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43c677e9-6008-567c-8dea-017ca611e696 with identifier: 1984677
2026-03-27 16:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43c677e9-6008-567c-8dea-017ca611e696 with scrape type 2
2026-03-27 16:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43c677e9-6008-567c-8dea-017ca611e696 with scrape type 2
2026-03-27 16:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 43c677e9-6008-567c-8dea-017ca611e696, identifier: 1984677
2026-03-27 16:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 43c677e9-6008-567c-8dea-017ca611e696 with identifier: 1984677
2026-03-27 16:36:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 43c677e9-6008-567c-8dea-017ca611e696 with identifier: 1984677
2026-03-27 16:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 43c677e9-6008-567c-8dea-017ca611e696 with identifier: 1984677 to the API
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Frozen pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '43c677e9-6008-567c-8dea-017ca611e696',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT COURIER 1.5 TDCi 75 cv Trend Vettura Furgonata 4-door '
'(Euro 6.2)',
'odometer': 163943,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT COURIER 1.5 TDCi 75 cv Trend Vettura Furgonata '
'4-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984677%27 HTTP/1.1" 200 None
2026-03-27 16:36:55 [ayvens.it] INFO: Saving data for 1984677: {'auction_closing_time': 1774859400.0, 'created_time': 1774542627.09834, 'last_price_update_time': 1774629415.233531}
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984677') HTTP/1.1" 204 0
2026-03-27 16:36:55 [ayvens.it] INFO: Found listing with ID: 1984678
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984678%27 HTTP/1.1" 200 None
2026-03-27 16:36:55 [ayvens.it] INFO: Scrape type for 1984678: 2
2026-03-27 16:36:55 [ayvens.it] INFO: Extracting data for car ID: 1984678
2026-03-27 16:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b73d15d-2027-52fb-896d-2532b974b3fc with identifier: 1984678
2026-03-27 16:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b73d15d-2027-52fb-896d-2532b974b3fc with scrape type 2
2026-03-27 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b73d15d-2027-52fb-896d-2532b974b3fc with scrape type 2
2026-03-27 16:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1b73d15d-2027-52fb-896d-2532b974b3fc, identifier: 1984678
2026-03-27 16:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1b73d15d-2027-52fb-896d-2532b974b3fc with identifier: 1984678
2026-03-27 16:36:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1b73d15d-2027-52fb-896d-2532b974b3fc with identifier: 1984678
2026-03-27 16:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1b73d15d-2027-52fb-896d-2532b974b3fc with identifier: 1984678 to the API
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '1b73d15d-2027-52fb-896d-2532b974b3fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina PHEV 225CV 2WD ST-Line X Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 23014,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina PHEV 225CV 2WD ST-Line X Aut Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984678%27 HTTP/1.1" 200 None
2026-03-27 16:36:55 [ayvens.it] INFO: Saving data for 1984678: {'auction_closing_time': 1774859400.0, 'created_time': 1774542675.28605, 'last_price_update_time': 1774629415.578225}
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984678') HTTP/1.1" 204 0
2026-03-27 16:36:55 [ayvens.it] INFO: Found listing with ID: 1984679
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984679%27 HTTP/1.1" 200 None
2026-03-27 16:36:55 [ayvens.it] INFO: Scrape type for 1984679: 2
2026-03-27 16:36:55 [ayvens.it] INFO: Extracting data for car ID: 1984679
2026-03-27 16:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e6c2784-32c0-5f06-ab7a-fd25db1f5902 with identifier: 1984679
2026-03-27 16:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6c2784-32c0-5f06-ab7a-fd25db1f5902 with scrape type 2
2026-03-27 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e6c2784-32c0-5f06-ab7a-fd25db1f5902 with scrape type 2
2026-03-27 16:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1e6c2784-32c0-5f06-ab7a-fd25db1f5902, identifier: 1984679
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d2f550>
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/10.jpg saved to cache
2026-03-27 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912ccd0>
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/4.jpg saved to cache
2026-03-27 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ec3dd0>
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/9.jpg saved to cache
2026-03-27 16:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fca710>
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/3.jpg saved to cache
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69237a90>
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/2.jpg saved to cache
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685216d0>
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/4.jpg saved to cache
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c69490>
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/5.jpg saved to cache
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1e6c2784-32c0-5f06-ab7a-fd25db1f5902 with identifier: 1984679
2026-03-27 16:36:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1e6c2784-32c0-5f06-ab7a-fd25db1f5902 with identifier: 1984679
2026-03-27 16:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1e6c2784-32c0-5f06-ab7a-fd25db1f5902 with identifier: 1984679 to the API
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Santorini Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '1e6c2784-32c0-5f06-ab7a-fd25db1f5902',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv Standard 4WD aut. Sport '
'utility vehicle 5-door (Euro 6D)',
'odometer': 109347,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 163cv Standard 4WD '
'aut. Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984679%27 HTTP/1.1" 200 None
2026-03-27 16:36:56 [ayvens.it] INFO: Saving data for 1984679: {'auction_closing_time': 1774859400.0, 'created_time': 1774542661.379522, 'last_price_update_time': 1774629416.546093}
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984679') HTTP/1.1" 204 0
2026-03-27 16:36:56 [ayvens.it] INFO: Found listing with ID: 1984680
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984680%27 HTTP/1.1" 200 None
2026-03-27 16:36:56 [ayvens.it] INFO: Scrape type for 1984680: 2
2026-03-27 16:36:56 [ayvens.it] INFO: Extracting data for car ID: 1984680
2026-03-27 16:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbd76b96-bab2-5092-81b0-94adf8f3baa6 with identifier: 1984680
2026-03-27 16:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbd76b96-bab2-5092-81b0-94adf8f3baa6 with scrape type 2
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbd76b96-bab2-5092-81b0-94adf8f3baa6 with scrape type 2
2026-03-27 16:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bbd76b96-bab2-5092-81b0-94adf8f3baa6, identifier: 1984680
2026-03-27 16:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bbd76b96-bab2-5092-81b0-94adf8f3baa6 with identifier: 1984680
2026-03-27 16:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bbd76b96-bab2-5092-81b0-94adf8f3baa6 with identifier: 1984680
2026-03-27 16:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bbd76b96-bab2-5092-81b0-94adf8f3baa6 with identifier: 1984680 to the API
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'bbd76b96-bab2-5092-81b0-94adf8f3baa6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT 350 L2H2 Trend 2.0 Eco MHEV 130 Cv Furgone 4-door '
'(Euro 6.2)',
'odometer': 69576,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-09',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT 350 L2H2 Trend 2.0 Eco MHEV 130 Cv Furgone 4-door '
'(Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984680%27 HTTP/1.1" 200 None
2026-03-27 16:36:56 [ayvens.it] INFO: Saving data for 1984680: {'auction_closing_time': 1774859400.0, 'created_time': 1774542635.848408, 'last_price_update_time': 1774629416.931686}
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984680') HTTP/1.1" 204 0
2026-03-27 16:36:56 [ayvens.it] INFO: Found listing with ID: 1984681
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984681%27 HTTP/1.1" 200 None
2026-03-27 16:36:56 [ayvens.it] INFO: Scrape type for 1984681: 2
2026-03-27 16:36:56 [ayvens.it] INFO: Extracting data for car ID: 1984681
2026-03-27 16:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e895a4fc-e1d9-5951-9640-80bfd2b8755c with identifier: 1984681
2026-03-27 16:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e895a4fc-e1d9-5951-9640-80bfd2b8755c with scrape type 2
2026-03-27 16:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e895a4fc-e1d9-5951-9640-80bfd2b8755c with scrape type 2
2026-03-27 16:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e895a4fc-e1d9-5951-9640-80bfd2b8755c, identifier: 1984681
2026-03-27 16:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e895a4fc-e1d9-5951-9640-80bfd2b8755c with identifier: 1984681
2026-03-27 16:36:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e895a4fc-e1d9-5951-9640-80bfd2b8755c with identifier: 1984681
2026-03-27 16:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e895a4fc-e1d9-5951-9640-80bfd2b8755c with identifier: 1984681 to the API
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DARK METAL GREY METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'e895a4fc-e1d9-5951-9640-80bfd2b8755c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI 1.5 HEV e-Power Business Auto Cross over 5-door '
'(Euro 6D)',
'odometer': 96517,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI 1.5 HEV e-Power Business Auto Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984681%27 HTTP/1.1" 200 None
2026-03-27 16:36:57 [ayvens.it] INFO: Saving data for 1984681: {'auction_closing_time': 1774859400.0, 'created_time': 1774542652.965428, 'last_price_update_time': 1774629417.276036}
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984681') HTTP/1.1" 204 0
2026-03-27 16:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:57 [ayvens.it] INFO: Found listing with ID: 1984682
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984682%27 HTTP/1.1" 200 None
2026-03-27 16:36:57 [ayvens.it] INFO: Scrape type for 1984682: 2
2026-03-27 16:36:57 [ayvens.it] INFO: Extracting data for car ID: 1984682
2026-03-27 16:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49b01d47-78a3-593c-92d3-447b311187ff with identifier: 1984682
2026-03-27 16:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49b01d47-78a3-593c-92d3-447b311187ff with scrape type 2
2026-03-27 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49b01d47-78a3-593c-92d3-447b311187ff with scrape type 2
2026-03-27 16:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 49b01d47-78a3-593c-92d3-447b311187ff, identifier: 1984682
2026-03-27 16:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 49b01d47-78a3-593c-92d3-447b311187ff with identifier: 1984682
2026-03-27 16:36:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 49b01d47-78a3-593c-92d3-447b311187ff with identifier: 1984682
2026-03-27 16:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 49b01d47-78a3-593c-92d3-447b311187ff with identifier: 1984682 to the API
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DEEP BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '49b01d47-78a3-593c-92d3-447b311187ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MINI',
'model': 'MINI CLUBMAN ONE D BUSINESS AUTOMATICA FP',
'odometer': 141310,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'MINI MINI CLUBMAN ONE D BUSINESS AUTOMATICA FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984682%27 HTTP/1.1" 200 None
2026-03-27 16:36:57 [ayvens.it] INFO: Saving data for 1984682: {'auction_closing_time': 1774859400.0, 'created_time': 1774542652.628982, 'last_price_update_time': 1774629417.656922}
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984682') HTTP/1.1" 204 0
2026-03-27 16:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fe9490>
2026-03-27 16:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/7.jpg saved to cache
2026-03-27 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:36:57 [ayvens.it] INFO: Found listing with ID: 1984683
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984683%27 HTTP/1.1" 200 None
2026-03-27 16:36:57 [ayvens.it] INFO: Scrape type for 1984683: 2
2026-03-27 16:36:57 [ayvens.it] INFO: Extracting data for car ID: 1984683
2026-03-27 16:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a5a9afc-1e48-544a-b27e-a075bfbd9157 with identifier: 1984683
2026-03-27 16:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a5a9afc-1e48-544a-b27e-a075bfbd9157 with scrape type 2
2026-03-27 16:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a5a9afc-1e48-544a-b27e-a075bfbd9157 with scrape type 2
2026-03-27 16:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1a5a9afc-1e48-544a-b27e-a075bfbd9157, identifier: 1984683
2026-03-27 16:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1a5a9afc-1e48-544a-b27e-a075bfbd9157 with identifier: 1984683
2026-03-27 16:36:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1a5a9afc-1e48-544a-b27e-a075bfbd9157 with identifier: 1984683
2026-03-27 16:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1a5a9afc-1e48-544a-b27e-a075bfbd9157 with identifier: 1984683 to the API
2026-03-27 16:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARTIC WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '1a5a9afc-1e48-544a-b27e-a075bfbd9157',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MAZDA',
'model': 'MAZDA CX-30 2.0L Skyactiv-X 180cv 4WD M Hybrid Excl. Sport utility '
'vehicle 5-door (Euro 6D) mild hybrid',
'odometer': 88293,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'MAZDA MAZDA CX-30 2.0L Skyactiv-X 180cv 4WD M Hybrid Excl. Sport '
'utility vehicle 5-door (Euro 6D) mild hybrid -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984683%27 HTTP/1.1" 200 None
2026-03-27 16:36:58 [ayvens.it] INFO: Saving data for 1984683: {'auction_closing_time': 1774859400.0, 'created_time': 1774542650.958833, 'last_price_update_time': 1774629418.170948}
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984683') HTTP/1.1" 204 0
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68533510>
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/6.jpg saved to cache
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c84f10>
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/8.jpg saved to cache
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b03590>
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/1.jpg saved to cache
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68abc810>
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs9%252F51f000f0bb4845459f4517a90326ece4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/1.jpg saved to cache
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1
2026-03-27 16:36:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47f549ab-bd39-5a99-a8d6-5518ebda49f1, skipping ID generation
2026-03-27 16:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1 with scrape type 1
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47f549ab-bd39-5a99-a8d6-5518ebda49f1 sending to next pipeline
2026-03-27 16:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 47f549ab-bd39-5a99-a8d6-5518ebda49f1, identifier: 1989041
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6941a990>
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/5.jpg saved to cache
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c9a850>
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/3.jpg saved to cache
2026-03-27 16:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:36:58 [ayvens.it] INFO: Found listing with ID: 1984684
2026-03-27 16:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984684%27 HTTP/1.1" 200 None
2026-03-27 16:36:59 [ayvens.it] INFO: Scrape type for 1984684: 2
2026-03-27 16:36:59 [ayvens.it] INFO: Extracting data for car ID: 1984684
2026-03-27 16:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a56fcd8f-d9b4-5d86-ab88-12771d19a329 with identifier: 1984684
2026-03-27 16:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a56fcd8f-d9b4-5d86-ab88-12771d19a329 with scrape type 2
2026-03-27 16:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a56fcd8f-d9b4-5d86-ab88-12771d19a329 with scrape type 2
2026-03-27 16:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a56fcd8f-d9b4-5d86-ab88-12771d19a329, identifier: 1984684
2026-03-27 16:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 47f549ab-bd39-5a99-a8d6-5518ebda49f1 with identifier: 1989041
2026-03-27 16:36:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 47f549ab-bd39-5a99-a8d6-5518ebda49f1 with identifier: 1989041
2026-03-27 16:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 47f549ab-bd39-5a99-a8d6-5518ebda49f1 with identifier: 1989041 to the API
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '47f549ab-bd39-5a99-a8d6-5518ebda49f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA YARIS 1.5 Hybrid Business Hatchback 5-door (Euro 6.2)',
'odometer': 90810,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437723,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474724,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f549ab-bd39-5a99-a8d6-5518ebda49f1/47f549ab-bd39-5a99-a8d6-5518ebda49f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454427,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs9/51f000f0bb4845459f4517a90326ece4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-13',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA YARIS 1.5 Hybrid Business Hatchback 5-door (Euro 6.2) '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989041%27 HTTP/1.1" 200 None
2026-03-27 16:36:59 [ayvens.it] INFO: Saving data for 1989041: {'created_time': 1774629419.452307, 'last_price_update_time': 1774629419.452317, 'auction_closing_time': 1774944000.0}
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989041') HTTP/1.1" 204 0
2026-03-27 16:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a56fcd8f-d9b4-5d86-ab88-12771d19a329 with identifier: 1984684
2026-03-27 16:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a56fcd8f-d9b4-5d86-ab88-12771d19a329 with identifier: 1984684
2026-03-27 16:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a56fcd8f-d9b4-5d86-ab88-12771d19a329 with identifier: 1984684 to the API
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO FROZEN PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'a56fcd8f-d9b4-5d86-ab88-12771d19a329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 ECOBLUE 120CV 2WD TITANIUM BUS. AUTO FP',
'odometer': 133185,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 ECOBLUE 120CV 2WD TITANIUM BUS. AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984684%27 HTTP/1.1" 200 None
2026-03-27 16:36:59 [ayvens.it] INFO: Saving data for 1984684: {'auction_closing_time': 1774859400.0, 'created_time': 1774542649.244219, 'last_price_update_time': 1774629419.694394}
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984684') HTTP/1.1" 204 0
2026-03-27 16:36:59 [ayvens.it] INFO: Found listing with ID: 1984685
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984685%27 HTTP/1.1" 200 None
2026-03-27 16:36:59 [ayvens.it] INFO: Scrape type for 1984685: 2
2026-03-27 16:36:59 [ayvens.it] INFO: Extracting data for car ID: 1984685
2026-03-27 16:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768d9ed6-f79e-5188-ba1e-292380d5f29e with identifier: 1984685
2026-03-27 16:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768d9ed6-f79e-5188-ba1e-292380d5f29e with scrape type 2
2026-03-27 16:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768d9ed6-f79e-5188-ba1e-292380d5f29e with scrape type 2
2026-03-27 16:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 768d9ed6-f79e-5188-ba1e-292380d5f29e, identifier: 1984685
2026-03-27 16:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccfd90>
2026-03-27 16:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/2.jpg saved to cache
2026-03-27 16:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 768d9ed6-f79e-5188-ba1e-292380d5f29e with identifier: 1984685
2026-03-27 16:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 768d9ed6-f79e-5188-ba1e-292380d5f29e with identifier: 1984685
2026-03-27 16:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 768d9ed6-f79e-5188-ba1e-292380d5f29e with identifier: 1984685 to the API
2026-03-27 16:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '768d9ed6-f79e-5188-ba1e-292380d5f29e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC)',
'odometer': 71693,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984685%27 HTTP/1.1" 200 None
2026-03-27 16:37:00 [ayvens.it] INFO: Saving data for 1984685: {'auction_closing_time': 1774859400.0, 'created_time': 1774542645.904785, 'last_price_update_time': 1774629420.153686}
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984685') HTTP/1.1" 204 0
2026-03-27 16:37:00 [ayvens.it] INFO: Found listing with ID: 1984686
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984686%27 HTTP/1.1" 200 None
2026-03-27 16:37:00 [ayvens.it] INFO: Scrape type for 1984686: 2
2026-03-27 16:37:00 [ayvens.it] INFO: Extracting data for car ID: 1984686
2026-03-27 16:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596da1d5-8f3a-545f-b925-fea18fabaaf9 with identifier: 1984686
2026-03-27 16:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596da1d5-8f3a-545f-b925-fea18fabaaf9 with scrape type 2
2026-03-27 16:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 596da1d5-8f3a-545f-b925-fea18fabaaf9 with scrape type 2
2026-03-27 16:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 596da1d5-8f3a-545f-b925-fea18fabaaf9, identifier: 1984686
2026-03-27 16:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 596da1d5-8f3a-545f-b925-fea18fabaaf9 with identifier: 1984686
2026-03-27 16:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 596da1d5-8f3a-545f-b925-fea18fabaaf9 with identifier: 1984686
2026-03-27 16:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 596da1d5-8f3a-545f-b925-fea18fabaaf9 with identifier: 1984686 to the API
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FUJI WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '596da1d5-8f3a-545f-b925-fea18fabaaf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 150CV SE 4WD AUT. FP',
'odometer': 115367,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-16',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 150CV SE 4WD AUT. FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984686%27 HTTP/1.1" 200 None
2026-03-27 16:37:00 [ayvens.it] INFO: Saving data for 1984686: {'auction_closing_time': 1774859400.0, 'created_time': 1774542643.092643, 'last_price_update_time': 1774629420.529237}
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984686') HTTP/1.1" 204 0
2026-03-27 16:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:00 [ayvens.it] INFO: Found listing with ID: 1984687
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984687%27 HTTP/1.1" 200 None
2026-03-27 16:37:00 [ayvens.it] INFO: Scrape type for 1984687: 2
2026-03-27 16:37:00 [ayvens.it] INFO: Extracting data for car ID: 1984687
2026-03-27 16:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4972e2d-ff80-57d4-b858-7df5dc879086 with identifier: 1984687
2026-03-27 16:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4972e2d-ff80-57d4-b858-7df5dc879086 with scrape type 2
2026-03-27 16:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4972e2d-ff80-57d4-b858-7df5dc879086 with scrape type 2
2026-03-27 16:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c4972e2d-ff80-57d4-b858-7df5dc879086, identifier: 1984687
2026-03-27 16:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c4972e2d-ff80-57d4-b858-7df5dc879086 with identifier: 1984687
2026-03-27 16:37:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c4972e2d-ff80-57d4-b858-7df5dc879086 with identifier: 1984687
2026-03-27 16:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c4972e2d-ff80-57d4-b858-7df5dc879086 with identifier: 1984687 to the API
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'EXPERIENCE GREEN',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'c4972e2d-ff80-57d4-b858-7df5dc879086',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'KIA SPORTAGE (PC) 1.6 CRDI MHEV BUSINESS 2WD DCT FP',
'odometer': 110672,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'KIA KIA SPORTAGE (PC) 1.6 CRDI MHEV BUSINESS 2WD DCT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984687%27 HTTP/1.1" 200 None
2026-03-27 16:37:00 [ayvens.it] INFO: Saving data for 1984687: {'auction_closing_time': 1774859400.0, 'created_time': 1774542647.022701, 'last_price_update_time': 1774629420.895201}
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984687') HTTP/1.1" 204 0
2026-03-27 16:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:00 [ayvens.it] INFO: Found listing with ID: 1984688
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984688%27 HTTP/1.1" 200 None
2026-03-27 16:37:00 [ayvens.it] INFO: Scrape type for 1984688: 2
2026-03-27 16:37:00 [ayvens.it] INFO: Extracting data for car ID: 1984688
2026-03-27 16:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612ca5cd-10e8-533c-979a-f4a55802cba6 with identifier: 1984688
2026-03-27 16:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612ca5cd-10e8-533c-979a-f4a55802cba6 with scrape type 2
2026-03-27 16:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612ca5cd-10e8-533c-979a-f4a55802cba6 with scrape type 2
2026-03-27 16:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 612ca5cd-10e8-533c-979a-f4a55802cba6, identifier: 1984688
2026-03-27 16:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 612ca5cd-10e8-533c-979a-f4a55802cba6 with identifier: 1984688
2026-03-27 16:37:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 612ca5cd-10e8-533c-979a-f4a55802cba6 with identifier: 1984688
2026-03-27 16:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 612ca5cd-10e8-533c-979a-f4a55802cba6 with identifier: 1984688 to the API
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Ascot Grey',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '612ca5cd-10e8-533c-979a-f4a55802cba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN T-ROC 2.0 TDI SCR Life DSG Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 167731,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN T-ROC 2.0 TDI SCR Life DSG Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984688%27 HTTP/1.1" 200 None
2026-03-27 16:37:01 [ayvens.it] INFO: Saving data for 1984688: {'auction_closing_time': 1774859400.0, 'created_time': 1774542648.299465, 'last_price_update_time': 1774629421.256982}
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984688') HTTP/1.1" 204 0
2026-03-27 16:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:01 [ayvens.it] INFO: Found listing with ID: 1984689
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984689%27 HTTP/1.1" 200 None
2026-03-27 16:37:01 [ayvens.it] INFO: Scrape type for 1984689: 2
2026-03-27 16:37:01 [ayvens.it] INFO: Extracting data for car ID: 1984689
2026-03-27 16:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bdc2a22-9e75-5a16-8a88-60c0a05a2376 with identifier: 1984689
2026-03-27 16:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdc2a22-9e75-5a16-8a88-60c0a05a2376 with scrape type 2
2026-03-27 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bdc2a22-9e75-5a16-8a88-60c0a05a2376 with scrape type 2
2026-03-27 16:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7bdc2a22-9e75-5a16-8a88-60c0a05a2376, identifier: 1984689
2026-03-27 16:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7bdc2a22-9e75-5a16-8a88-60c0a05a2376 with identifier: 1984689
2026-03-27 16:37:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7bdc2a22-9e75-5a16-8a88-60c0a05a2376 with identifier: 1984689
2026-03-27 16:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7bdc2a22-9e75-5a16-8a88-60c0a05a2376 with identifier: 1984689 to the API
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Steel Grey metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '7bdc2a22-9e75-5a16-8a88-60c0a05a2376',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROËN C3 AIRCROSS BlueHDi 110 S&S Feel',
'odometer': 48380,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROËN C3 AIRCROSS BlueHDi 110 S&S Feel -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984689%27 HTTP/1.1" 200 None
2026-03-27 16:37:01 [ayvens.it] INFO: Saving data for 1984689: {'auction_closing_time': 1774859400.0, 'created_time': 1774542650.616939, 'last_price_update_time': 1774629421.617044}
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984689') HTTP/1.1" 204 0
2026-03-27 16:37:01 [ayvens.it] INFO: Found listing with ID: 1984690
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984690%27 HTTP/1.1" 200 None
2026-03-27 16:37:01 [ayvens.it] INFO: Scrape type for 1984690: 2
2026-03-27 16:37:01 [ayvens.it] INFO: Extracting data for car ID: 1984690
2026-03-27 16:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede1d524-72e9-5e47-a6c9-41b572889200 with identifier: 1984690
2026-03-27 16:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede1d524-72e9-5e47-a6c9-41b572889200 with scrape type 2
2026-03-27 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ede1d524-72e9-5e47-a6c9-41b572889200 with scrape type 2
2026-03-27 16:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ede1d524-72e9-5e47-a6c9-41b572889200, identifier: 1984690
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fccb50>
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/4.jpg saved to cache
2026-03-27 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f5610>
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/5.jpg saved to cache
2026-03-27 16:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fac590>
2026-03-27 16:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/3.jpg saved to cache
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0ebd0>
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/10.jpg saved to cache
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923c5d0>
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/2.jpg saved to cache
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f0f450>
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/1.jpg saved to cache
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6941bed0>
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/6.jpg saved to cache
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ede1d524-72e9-5e47-a6c9-41b572889200 with identifier: 1984690
2026-03-27 16:37:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ede1d524-72e9-5e47-a6c9-41b572889200 with identifier: 1984690
2026-03-27 16:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ede1d524-72e9-5e47-a6c9-41b572889200 with identifier: 1984690 to the API
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Summit White',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol_lpg',
'id': 'ede1d524-72e9-5e47-a6c9-41b572889200',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND X 1.2 GPL 81cv Advance MT5 Cross over 5-door (Euro '
'6)',
'odometer': 102261,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND X 1.2 GPL 81cv Advance MT5 Cross over 5-door '
'(Euro 6) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984690%27 HTTP/1.1" 200 None
2026-03-27 16:37:02 [ayvens.it] INFO: Saving data for 1984690: {'auction_closing_time': 1774859400.0, 'created_time': 1774542654.366596, 'last_price_update_time': 1774629422.617596}
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984690') HTTP/1.1" 204 0
2026-03-27 16:37:02 [ayvens.it] INFO: Found listing with ID: 1984691
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984691%27 HTTP/1.1" 200 None
2026-03-27 16:37:02 [ayvens.it] INFO: Scrape type for 1984691: 2
2026-03-27 16:37:02 [ayvens.it] INFO: Extracting data for car ID: 1984691
2026-03-27 16:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c268ef-2a93-50c1-8917-12129a308061 with identifier: 1984691
2026-03-27 16:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c268ef-2a93-50c1-8917-12129a308061 with scrape type 2
2026-03-27 16:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39c268ef-2a93-50c1-8917-12129a308061 with scrape type 2
2026-03-27 16:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 39c268ef-2a93-50c1-8917-12129a308061, identifier: 1984691
2026-03-27 16:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 39c268ef-2a93-50c1-8917-12129a308061 with identifier: 1984691
2026-03-27 16:37:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 39c268ef-2a93-50c1-8917-12129a308061 with identifier: 1984691
2026-03-27 16:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 39c268ef-2a93-50c1-8917-12129a308061 with identifier: 1984691 to the API
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU COSMO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '39c268ef-2a93-50c1-8917-12129a308061',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT MEGANE SW (PC) 1.5 DCI 85KW BLUE BUSINESS EDC FP',
'odometer': 151882,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT MEGANE SW (PC) 1.5 DCI 85KW BLUE BUSINESS EDC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984691%27 HTTP/1.1" 200 None
2026-03-27 16:37:02 [ayvens.it] INFO: Saving data for 1984691: {'auction_closing_time': 1774859400.0, 'created_time': 1774542655.934205, 'last_price_update_time': 1774629422.98665}
2026-03-27 16:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984691') HTTP/1.1" 204 0
2026-03-27 16:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ba3c50>
2026-03-27 16:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252F02c424a70c9548d9bf63b3f2284fc9ac%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/9.jpg saved to cache
2026-03-27 16:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc
2026-03-27 16:37:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc, skipping ID generation
2026-03-27 16:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc with scrape type 1
2026-03-27 16:37:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc sending to next pipeline
2026-03-27 16:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc, identifier: 1989042
2026-03-27 16:37:03 [ayvens.it] INFO: Found listing with ID: 1984692
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984692%27 HTTP/1.1" 200 None
2026-03-27 16:37:03 [ayvens.it] INFO: Scrape type for 1984692: 2
2026-03-27 16:37:03 [ayvens.it] INFO: Extracting data for car ID: 1984692
2026-03-27 16:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae3b9180-cb69-56c5-9442-5035c3f17070 with identifier: 1984692
2026-03-27 16:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae3b9180-cb69-56c5-9442-5035c3f17070 with scrape type 2
2026-03-27 16:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae3b9180-cb69-56c5-9442-5035c3f17070 with scrape type 2
2026-03-27 16:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ae3b9180-cb69-56c5-9442-5035c3f17070, identifier: 1984692
2026-03-27 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc with identifier: 1989042
2026-03-27 16:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc with identifier: 1989042
2026-03-27 16:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc with identifier: 1989042 to the API
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT TIPO CONSIP13 1.3 MJT 95CV 5M S&S POP FP',
'odometer': 122523,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 68,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647776,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521465,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc/7fcbb9f8-66cf-5a41-9abb-ae2610ecfbdc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/02c424a70c9548d9bf63b3f2284fc9ac/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT TIPO CONSIP13 1.3 MJT 95CV 5M S&S POP FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989042%27 HTTP/1.1" 200 None
2026-03-27 16:37:03 [ayvens.it] INFO: Saving data for 1989042: {'created_time': 1774629423.622447, 'last_price_update_time': 1774629423.622457, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989042') HTTP/1.1" 204 0
2026-03-27 16:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ae3b9180-cb69-56c5-9442-5035c3f17070 with identifier: 1984692
2026-03-27 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ae3b9180-cb69-56c5-9442-5035c3f17070 with identifier: 1984692
2026-03-27 16:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ae3b9180-cb69-56c5-9442-5035c3f17070 with identifier: 1984692 to the API
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'ae3b9180-cb69-56c5-9442-5035c3f17070',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLO CARGO CH1 BUSINESS 1.3 MJET 95CV E6D S&S FP (PC) FP',
'odometer': 128770,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-24',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLO CARGO CH1 BUSINESS 1.3 MJET 95CV E6D S&S FP (PC) FP '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984692%27 HTTP/1.1" 200 None
2026-03-27 16:37:03 [ayvens.it] INFO: Saving data for 1984692: {'auction_closing_time': 1774859400.0, 'created_time': 1774542659.755827, 'last_price_update_time': 1774629423.885385}
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984692') HTTP/1.1" 204 0
2026-03-27 16:37:03 [ayvens.it] INFO: Found listing with ID: 1984693
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984693%27 HTTP/1.1" 200 None
2026-03-27 16:37:03 [ayvens.it] INFO: Scrape type for 1984693: 2
2026-03-27 16:37:03 [ayvens.it] INFO: Extracting data for car ID: 1984693
2026-03-27 16:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62a9e5b4-2d3f-599f-abf5-6dc9c3fec098 with identifier: 1984693
2026-03-27 16:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62a9e5b4-2d3f-599f-abf5-6dc9c3fec098 with scrape type 2
2026-03-27 16:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62a9e5b4-2d3f-599f-abf5-6dc9c3fec098 with scrape type 2
2026-03-27 16:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 62a9e5b4-2d3f-599f-abf5-6dc9c3fec098, identifier: 1984693
2026-03-27 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 62a9e5b4-2d3f-599f-abf5-6dc9c3fec098 with identifier: 1984693
2026-03-27 16:37:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 62a9e5b4-2d3f-599f-abf5-6dc9c3fec098 with identifier: 1984693
2026-03-27 16:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 62a9e5b4-2d3f-599f-abf5-6dc9c3fec098 with identifier: 1984693 to the API
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO CINEMA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '62a9e5b4-2d3f-599f-abf5-6dc9c3fec098',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA (PC) 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP',
'odometer': 110181,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA (PC) 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984693%27 HTTP/1.1" 200 None
2026-03-27 16:37:04 [ayvens.it] INFO: Saving data for 1984693: {'auction_closing_time': 1774859400.0, 'created_time': 1774542659.386916, 'last_price_update_time': 1774629424.277733}
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984693') HTTP/1.1" 204 0
2026-03-27 16:37:04 [ayvens.it] INFO: Found listing with ID: 1984694
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984694%27 HTTP/1.1" 200 None
2026-03-27 16:37:04 [ayvens.it] INFO: Scrape type for 1984694: 2
2026-03-27 16:37:04 [ayvens.it] INFO: Extracting data for car ID: 1984694
2026-03-27 16:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 927945b4-d7d6-5e8d-a7ac-ee78faa7fc7a with identifier: 1984694
2026-03-27 16:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 927945b4-d7d6-5e8d-a7ac-ee78faa7fc7a with scrape type 2
2026-03-27 16:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 927945b4-d7d6-5e8d-a7ac-ee78faa7fc7a with scrape type 2
2026-03-27 16:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 927945b4-d7d6-5e8d-a7ac-ee78faa7fc7a, identifier: 1984694
2026-03-27 16:37:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69140d10>
2026-03-27 16:37:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/10.jpg saved to cache
2026-03-27 16:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 927945b4-d7d6-5e8d-a7ac-ee78faa7fc7a with identifier: 1984694
2026-03-27 16:37:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 927945b4-d7d6-5e8d-a7ac-ee78faa7fc7a with identifier: 1984694
2026-03-27 16:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 927945b4-d7d6-5e8d-a7ac-ee78faa7fc7a with identifier: 1984694 to the API
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '927945b4-d7d6-5e8d-a7ac-ee78faa7fc7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA TS 2.0 Hybrid MoreBusiness SW 5-door (Euro 6.2)',
'odometer': 168275,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA TS 2.0 Hybrid MoreBusiness SW 5-door (Euro '
'6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984694%27 HTTP/1.1" 200 None
2026-03-27 16:37:04 [ayvens.it] INFO: Saving data for 1984694: {'auction_closing_time': 1774859400.0, 'created_time': 1774542662.828586, 'last_price_update_time': 1774629424.715454}
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984694') HTTP/1.1" 204 0
2026-03-27 16:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:04 [ayvens.it] INFO: Found listing with ID: 1984695
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984695%27 HTTP/1.1" 200 None
2026-03-27 16:37:04 [ayvens.it] INFO: Scrape type for 1984695: 2
2026-03-27 16:37:04 [ayvens.it] INFO: Extracting data for car ID: 1984695
2026-03-27 16:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f12c2f2-3e70-59ff-ad32-a8053db36ef5 with identifier: 1984695
2026-03-27 16:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f12c2f2-3e70-59ff-ad32-a8053db36ef5 with scrape type 2
2026-03-27 16:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f12c2f2-3e70-59ff-ad32-a8053db36ef5 with scrape type 2
2026-03-27 16:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4f12c2f2-3e70-59ff-ad32-a8053db36ef5, identifier: 1984695
2026-03-27 16:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4f12c2f2-3e70-59ff-ad32-a8053db36ef5 with identifier: 1984695
2026-03-27 16:37:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4f12c2f2-3e70-59ff-ad32-a8053db36ef5 with identifier: 1984695
2026-03-27 16:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4f12c2f2-3e70-59ff-ad32-a8053db36ef5 with identifier: 1984695 to the API
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PEBBLE GREY MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '4f12c2f2-3e70-59ff-ad32-a8053db36ef5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO V60 B4 D AUTOM. INSCRIPTION FP',
'odometer': 81478,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO V60 B4 D AUTOM. INSCRIPTION FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984695%27 HTTP/1.1" 200 None
2026-03-27 16:37:05 [ayvens.it] INFO: Saving data for 1984695: {'auction_closing_time': 1774859400.0, 'created_time': 1774542670.45012, 'last_price_update_time': 1774629425.342751}
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984695') HTTP/1.1" 204 0
2026-03-27 16:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:05 [ayvens.it] INFO: Found listing with ID: 1984696
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984696%27 HTTP/1.1" 200 None
2026-03-27 16:37:05 [ayvens.it] INFO: Scrape type for 1984696: 2
2026-03-27 16:37:05 [ayvens.it] INFO: Extracting data for car ID: 1984696
2026-03-27 16:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 056b34e8-93ae-5f4f-8224-8bf8e2e2d210 with identifier: 1984696
2026-03-27 16:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 056b34e8-93ae-5f4f-8224-8bf8e2e2d210 with scrape type 2
2026-03-27 16:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 056b34e8-93ae-5f4f-8224-8bf8e2e2d210 with scrape type 2
2026-03-27 16:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 056b34e8-93ae-5f4f-8224-8bf8e2e2d210, identifier: 1984696
2026-03-27 16:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 056b34e8-93ae-5f4f-8224-8bf8e2e2d210 with identifier: 1984696
2026-03-27 16:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 056b34e8-93ae-5f4f-8224-8bf8e2e2d210 with identifier: 1984696
2026-03-27 16:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 056b34e8-93ae-5f4f-8224-8bf8e2e2d210 with identifier: 1984696 to the API
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Gelato pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '056b34e8-93ae-5f4f-8224-8bf8e2e2d210',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500X 1.3 Mjet 95cv E6D Connect Cross over 5-door (Euro 6D)',
'odometer': 130777,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500X 1.3 Mjet 95cv E6D Connect Cross over 5-door (Euro '
'6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984696%27 HTTP/1.1" 200 None
2026-03-27 16:37:05 [ayvens.it] INFO: Saving data for 1984696: {'auction_closing_time': 1774859400.0, 'created_time': 1774542665.442288, 'last_price_update_time': 1774629425.692173}
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984696') HTTP/1.1" 204 0
2026-03-27 16:37:05 [ayvens.it] INFO: Found listing with ID: 1984697
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984697%27 HTTP/1.1" 200 None
2026-03-27 16:37:05 [ayvens.it] INFO: Scrape type for 1984697: 2
2026-03-27 16:37:05 [ayvens.it] INFO: Extracting data for car ID: 1984697
2026-03-27 16:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fae1455a-015b-5da5-b645-6aea74f72381 with identifier: 1984697
2026-03-27 16:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fae1455a-015b-5da5-b645-6aea74f72381 with scrape type 2
2026-03-27 16:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fae1455a-015b-5da5-b645-6aea74f72381 with scrape type 2
2026-03-27 16:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fae1455a-015b-5da5-b645-6aea74f72381, identifier: 1984697
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69514110>
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/7.jpg saved to cache
2026-03-27 16:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b330d0>
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/9.jpg saved to cache
2026-03-27 16:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69418890>
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb6%252Fc8f8c5d738694b009973926a32860cdb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/8.jpg saved to cache
2026-03-27 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9
2026-03-27 16:37:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddd94fe0-587b-55b9-b4ba-3943a76d00d9, skipping ID generation
2026-03-27 16:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9 with scrape type 1
2026-03-27 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddd94fe0-587b-55b9-b4ba-3943a76d00d9 sending to next pipeline
2026-03-27 16:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ddd94fe0-587b-55b9-b4ba-3943a76d00d9, identifier: 1989043
2026-03-27 16:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6923e190>
2026-03-27 16:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/4.jpg saved to cache
2026-03-27 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69426cd0>
2026-03-27 16:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt0%252F45848d76ed4c439483cf7dc92ee6596c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/3.jpg saved to cache
2026-03-27 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32732ab0-9da5-50bd-be8b-353261455ef9
2026-03-27 16:37:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32732ab0-9da5-50bd-be8b-353261455ef9, skipping ID generation
2026-03-27 16:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32732ab0-9da5-50bd-be8b-353261455ef9 with scrape type 1
2026-03-27 16:37:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32732ab0-9da5-50bd-be8b-353261455ef9 sending to next pipeline
2026-03-27 16:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 32732ab0-9da5-50bd-be8b-353261455ef9, identifier: 1989039
2026-03-27 16:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fae1455a-015b-5da5-b645-6aea74f72381 with identifier: 1984697
2026-03-27 16:37:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fae1455a-015b-5da5-b645-6aea74f72381 with identifier: 1984697
2026-03-27 16:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fae1455a-015b-5da5-b645-6aea74f72381 with identifier: 1984697 to the API
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO IBIS TINTA UNITA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'fae1455a-015b-5da5-b645-6aea74f72381',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 (PC) 35 TDI S TRONIC BUSINESS S.BACK FP',
'odometer': 164358,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 (PC) 35 TDI S TRONIC BUSINESS S.BACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984697%27 HTTP/1.1" 200 None
2026-03-27 16:37:06 [ayvens.it] INFO: Saving data for 1984697: {'auction_closing_time': 1774859400.0, 'created_time': 1774542668.549891, 'last_price_update_time': 1774629426.816245}
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984697') HTTP/1.1" 204 0
2026-03-27 16:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ddd94fe0-587b-55b9-b4ba-3943a76d00d9 with identifier: 1989043
2026-03-27 16:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ddd94fe0-587b-55b9-b4ba-3943a76d00d9 with identifier: 1989043
2026-03-27 16:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ddd94fe0-587b-55b9-b4ba-3943a76d00d9 with identifier: 1989043 to the API
2026-03-27 16:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol_lpg',
'id': 'ddd94fe0-587b-55b9-b4ba-3943a76d00d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP',
'odometer': 64852,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624084,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588869,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd94fe0-587b-55b9-b4ba-3943a76d00d9/ddd94fe0-587b-55b9-b4ba-3943a76d00d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb6/c8f8c5d738694b009973926a32860cdb/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989043%27 HTTP/1.1" 200 None
2026-03-27 16:37:07 [ayvens.it] INFO: Saving data for 1989043: {'created_time': 1774629427.197385, 'last_price_update_time': 1774629427.197395, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989043') HTTP/1.1" 204 0
2026-03-27 16:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 32732ab0-9da5-50bd-be8b-353261455ef9 with identifier: 1989039
2026-03-27 16:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 32732ab0-9da5-50bd-be8b-353261455ef9 with identifier: 1989039
2026-03-27 16:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 32732ab0-9da5-50bd-be8b-353261455ef9 with identifier: 1989039 to the API
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SANTORINI BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '32732ab0-9da5-50bd-be8b-353261455ef9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER VEL 2.0D I4 204 R-DYNAMIC SE 4WD AUTO FP '
'(PC) FP',
'odometer': 45011,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 57,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 769293,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 715180,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 729390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427962,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32732ab0-9da5-50bd-be8b-353261455ef9/32732ab0-9da5-50bd-be8b-353261455ef9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt0/45848d76ed4c439483cf7dc92ee6596c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER VEL 2.0D I4 204 R-DYNAMIC SE 4WD '
'AUTO FP (PC) FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989039%27 HTTP/1.1" 200 None
2026-03-27 16:37:07 [ayvens.it] INFO: Saving data for 1989039: {'created_time': 1774629427.545783, 'last_price_update_time': 1774629427.545794, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989039') HTTP/1.1" 204 0
2026-03-27 16:37:07 [scrapy.extensions.logstats] INFO: Crawled 18 pages (at -1 pages/min), scraped 182 items (at 43 items/min)
2026-03-27 16:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-27 16:37:07 [ayvens.it] INFO: Found listing with ID: 1984698
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984698%27 HTTP/1.1" 200 None
2026-03-27 16:37:07 [ayvens.it] INFO: Scrape type for 1984698: 2
2026-03-27 16:37:07 [ayvens.it] INFO: Extracting data for car ID: 1984698
2026-03-27 16:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f95db2e-3134-540d-9ccf-4567704681b0 with identifier: 1984698
2026-03-27 16:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f95db2e-3134-540d-9ccf-4567704681b0 with scrape type 2
2026-03-27 16:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f95db2e-3134-540d-9ccf-4567704681b0 with scrape type 2
2026-03-27 16:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8f95db2e-3134-540d-9ccf-4567704681b0, identifier: 1984698
2026-03-27 16:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6921dc90>
2026-03-27 16:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/5.jpg saved to cache
2026-03-27 16:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692fbb10>
2026-03-27 16:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/4.jpg saved to cache
2026-03-27 16:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8f95db2e-3134-540d-9ccf-4567704681b0 with identifier: 1984698
2026-03-27 16:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8f95db2e-3134-540d-9ccf-4567704681b0 with identifier: 1984698
2026-03-27 16:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8f95db2e-3134-540d-9ccf-4567704681b0 with identifier: 1984698 to the API
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ALPINE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '8f95db2e-3134-540d-9ccf-4567704681b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 (PC) SDRIVE 18D EDITION ESSENCE DCT FP',
'odometer': 134609,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 (PC) SDRIVE 18D EDITION ESSENCE DCT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984698%27 HTTP/1.1" 200 None
2026-03-27 16:37:08 [ayvens.it] INFO: Saving data for 1984698: {'auction_closing_time': 1774859400.0, 'created_time': 1774542667.751459, 'last_price_update_time': 1774629428.0728}
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984698') HTTP/1.1" 204 0
2026-03-27 16:37:08 [ayvens.it] INFO: Found listing with ID: 1984699
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984699%27 HTTP/1.1" 200 None
2026-03-27 16:37:08 [ayvens.it] INFO: Scrape type for 1984699: 2
2026-03-27 16:37:08 [ayvens.it] INFO: Extracting data for car ID: 1984699
2026-03-27 16:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbc683a2-dee7-5b19-bcf2-d935acc7edf3 with identifier: 1984699
2026-03-27 16:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbc683a2-dee7-5b19-bcf2-d935acc7edf3 with scrape type 2
2026-03-27 16:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbc683a2-dee7-5b19-bcf2-d935acc7edf3 with scrape type 2
2026-03-27 16:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cbc683a2-dee7-5b19-bcf2-d935acc7edf3, identifier: 1984699
2026-03-27 16:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cbc683a2-dee7-5b19-bcf2-d935acc7edf3 with identifier: 1984699
2026-03-27 16:37:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cbc683a2-dee7-5b19-bcf2-d935acc7edf3 with identifier: 1984699
2026-03-27 16:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cbc683a2-dee7-5b19-bcf2-d935acc7edf3 with identifier: 1984699 to the API
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Madreperla tinta specia',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'cbc683a2-dee7-5b19-bcf2-d935acc7edf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 BlueHDI 130 EAT8 S&S Active Pack Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 139737,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 BlueHDI 130 EAT8 S&S Active Pack Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984699%27 HTTP/1.1" 200 None
2026-03-27 16:37:08 [ayvens.it] INFO: Saving data for 1984699: {'auction_closing_time': 1774859400.0, 'created_time': 1774542669.968568, 'last_price_update_time': 1774629428.471069}
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984699') HTTP/1.1" 204 0
2026-03-27 16:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:08 [ayvens.it] INFO: Found listing with ID: 1984700
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984700%27 HTTP/1.1" 200 None
2026-03-27 16:37:08 [ayvens.it] INFO: Scrape type for 1984700: 2
2026-03-27 16:37:08 [ayvens.it] INFO: Extracting data for car ID: 1984700
2026-03-27 16:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d77f97b7-df77-57c6-98c7-1a72c032aa40 with identifier: 1984700
2026-03-27 16:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d77f97b7-df77-57c6-98c7-1a72c032aa40 with scrape type 2
2026-03-27 16:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d77f97b7-df77-57c6-98c7-1a72c032aa40 with scrape type 2
2026-03-27 16:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d77f97b7-df77-57c6-98c7-1a72c032aa40, identifier: 1984700
2026-03-27 16:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d77f97b7-df77-57c6-98c7-1a72c032aa40 with identifier: 1984700
2026-03-27 16:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d77f97b7-df77-57c6-98c7-1a72c032aa40 with identifier: 1984700
2026-03-27 16:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d77f97b7-df77-57c6-98c7-1a72c032aa40 with identifier: 1984700 to the API
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'd77f97b7-df77-57c6-98c7-1a72c032aa40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 30004,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984700%27 HTTP/1.1" 200 None
2026-03-27 16:37:08 [ayvens.it] INFO: Saving data for 1984700: {'auction_closing_time': 1774859400.0, 'created_time': 1774542673.916235, 'last_price_update_time': 1774629428.877195}
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984700') HTTP/1.1" 204 0
2026-03-27 16:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:08 [ayvens.it] INFO: Found listing with ID: 1984701
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984701%27 HTTP/1.1" 200 None
2026-03-27 16:37:08 [ayvens.it] INFO: Scrape type for 1984701: 2
2026-03-27 16:37:08 [ayvens.it] INFO: Extracting data for car ID: 1984701
2026-03-27 16:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4aafb67-514f-5182-8635-29114f4e4041 with identifier: 1984701
2026-03-27 16:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4aafb67-514f-5182-8635-29114f4e4041 with scrape type 2
2026-03-27 16:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4aafb67-514f-5182-8635-29114f4e4041 with scrape type 2
2026-03-27 16:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d4aafb67-514f-5182-8635-29114f4e4041, identifier: 1984701
2026-03-27 16:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d4aafb67-514f-5182-8635-29114f4e4041 with identifier: 1984701
2026-03-27 16:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d4aafb67-514f-5182-8635-29114f4e4041 with identifier: 1984701
2026-03-27 16:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d4aafb67-514f-5182-8635-29114f4e4041 with identifier: 1984701 to the API
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': 'd4aafb67-514f-5182-8635-29114f4e4041',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP',
'odometer': 120463,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984701%27 HTTP/1.1" 200 None
2026-03-27 16:37:09 [ayvens.it] INFO: Saving data for 1984701: {'auction_closing_time': 1774859400.0, 'created_time': 1774542674.457856, 'last_price_update_time': 1774629429.337013}
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984701') HTTP/1.1" 204 0
2026-03-27 16:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:09 [ayvens.it] INFO: Found listing with ID: 1984702
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984702%27 HTTP/1.1" 200 None
2026-03-27 16:37:09 [ayvens.it] INFO: Scrape type for 1984702: 2
2026-03-27 16:37:09 [ayvens.it] INFO: Extracting data for car ID: 1984702
2026-03-27 16:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ab877c2-bc5a-5504-8512-669e2f6bfb3a with identifier: 1984702
2026-03-27 16:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab877c2-bc5a-5504-8512-669e2f6bfb3a with scrape type 2
2026-03-27 16:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ab877c2-bc5a-5504-8512-669e2f6bfb3a with scrape type 2
2026-03-27 16:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6ab877c2-bc5a-5504-8512-669e2f6bfb3a, identifier: 1984702
2026-03-27 16:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922fb10>
2026-03-27 16:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/8.jpg saved to cache
2026-03-27 16:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cc5510>
2026-03-27 16:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp9%252Fcdb9b8ef54db4e358a18aee11a04c694%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/7.jpg saved to cache
2026-03-27 16:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a32798c-e97d-5414-88b4-cf4e856b4599
2026-03-27 16:37:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a32798c-e97d-5414-88b4-cf4e856b4599, skipping ID generation
2026-03-27 16:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a32798c-e97d-5414-88b4-cf4e856b4599 with scrape type 1
2026-03-27 16:37:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a32798c-e97d-5414-88b4-cf4e856b4599 sending to next pipeline
2026-03-27 16:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6a32798c-e97d-5414-88b4-cf4e856b4599, identifier: 1989034
2026-03-27 16:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6ab877c2-bc5a-5504-8512-669e2f6bfb3a with identifier: 1984702
2026-03-27 16:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6ab877c2-bc5a-5504-8512-669e2f6bfb3a with identifier: 1984702
2026-03-27 16:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6ab877c2-bc5a-5504-8512-669e2f6bfb3a with identifier: 1984702 to the API
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '6ab877c2-bc5a-5504-8512-669e2f6bfb3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV BUSINESS SW FP',
'odometer': 116592,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV BUSINESS SW FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984702%27 HTTP/1.1" 200 None
2026-03-27 16:37:09 [ayvens.it] INFO: Saving data for 1984702: {'auction_closing_time': 1774859400.0, 'created_time': 1774542676.400339, 'last_price_update_time': 1774629429.994964}
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984702') HTTP/1.1" 204 0
2026-03-27 16:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6a32798c-e97d-5414-88b4-cf4e856b4599 with identifier: 1989034
2026-03-27 16:37:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6a32798c-e97d-5414-88b4-cf4e856b4599 with identifier: 1989034
2026-03-27 16:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6a32798c-e97d-5414-88b4-cf4e856b4599 with identifier: 1989034 to the API
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO DOLPHIN METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '6a32798c-e97d-5414-88b4-cf4e856b4599',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SEAT',
'model': 'SEAT TARRACO 2.0 TDI BUSINESS DSG FP',
'odometer': 60533,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 659322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 659322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a32798c-e97d-5414-88b4-cf4e856b4599/6a32798c-e97d-5414-88b4-cf4e856b4599_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp9/cdb9b8ef54db4e358a18aee11a04c694/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT SEAT TARRACO 2.0 TDI BUSINESS DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989034%27 HTTP/1.1" 200 None
2026-03-27 16:37:10 [ayvens.it] INFO: Saving data for 1989034: {'created_time': 1774629430.36027, 'last_price_update_time': 1774629430.360281, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989034') HTTP/1.1" 204 0
2026-03-27 16:37:10 [ayvens.it] INFO: Found listing with ID: 1984703
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984703%27 HTTP/1.1" 200 None
2026-03-27 16:37:10 [ayvens.it] INFO: Scrape type for 1984703: 2
2026-03-27 16:37:10 [ayvens.it] INFO: Extracting data for car ID: 1984703
2026-03-27 16:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26fdc725-c6f2-591a-9110-020e9695b623 with identifier: 1984703
2026-03-27 16:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26fdc725-c6f2-591a-9110-020e9695b623 with scrape type 2
2026-03-27 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26fdc725-c6f2-591a-9110-020e9695b623 with scrape type 2
2026-03-27 16:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 26fdc725-c6f2-591a-9110-020e9695b623, identifier: 1984703
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692fa590>
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr0%252F43c75d338bf44fcbbd96a68a2f7e2d25%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/3.jpg saved to cache
2026-03-27 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d8a2d91-364b-538d-afa1-130aa588e53b
2026-03-27 16:37:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d8a2d91-364b-538d-afa1-130aa588e53b, skipping ID generation
2026-03-27 16:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d8a2d91-364b-538d-afa1-130aa588e53b with scrape type 1
2026-03-27 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d8a2d91-364b-538d-afa1-130aa588e53b sending to next pipeline
2026-03-27 16:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0d8a2d91-364b-538d-afa1-130aa588e53b, identifier: 1989038
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b234750>
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd2%252Fd4a0dfa2e8594710876d61bcd4fbdbed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/4.jpg saved to cache
2026-03-27 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 643e4064-cf92-549c-bf5c-480cecac0cce
2026-03-27 16:37:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 643e4064-cf92-549c-bf5c-480cecac0cce, skipping ID generation
2026-03-27 16:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643e4064-cf92-549c-bf5c-480cecac0cce with scrape type 1
2026-03-27 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 643e4064-cf92-549c-bf5c-480cecac0cce sending to next pipeline
2026-03-27 16:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 643e4064-cf92-549c-bf5c-480cecac0cce, identifier: 1989037
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bc2ed0>
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/8.jpg saved to cache
2026-03-27 16:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 26fdc725-c6f2-591a-9110-020e9695b623 with identifier: 1984703
2026-03-27 16:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 26fdc725-c6f2-591a-9110-020e9695b623 with identifier: 1984703
2026-03-27 16:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 26fdc725-c6f2-591a-9110-020e9695b623 with identifier: 1984703 to the API
2026-03-27 16:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '26fdc725-c6f2-591a-9110-020e9695b623',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S BUSINESS COMBI FP',
'odometer': 132346,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S BUSINESS COMBI FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984703%27 HTTP/1.1" 200 None
2026-03-27 16:37:11 [ayvens.it] INFO: Saving data for 1984703: {'auction_closing_time': 1774859400.0, 'created_time': 1774542678.71662, 'last_price_update_time': 1774629431.15529}
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984703') HTTP/1.1" 204 0
2026-03-27 16:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0d8a2d91-364b-538d-afa1-130aa588e53b with identifier: 1989038
2026-03-27 16:37:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0d8a2d91-364b-538d-afa1-130aa588e53b with identifier: 1989038
2026-03-27 16:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0d8a2d91-364b-538d-afa1-130aa588e53b with identifier: 1989038 to the API
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU ELEGANTE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '0d8a2d91-364b-538d-afa1-130aa588e53b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LANCIA',
'model': 'LANCIA YPSILON 1.0 FireFly 70cv Hybrid Silver Hatchback 5-door',
'odometer': 72696,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 56,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 877203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 870845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 877203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 848122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 821672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591394,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8a2d91-364b-538d-afa1-130aa588e53b/0d8a2d91-364b-538d-afa1-130aa588e53b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr0/43c75d338bf44fcbbd96a68a2f7e2d25/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'LANCIA LANCIA YPSILON 1.0 FireFly 70cv Hybrid Silver Hatchback '
'5-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989038%27 HTTP/1.1" 200 None
2026-03-27 16:37:11 [ayvens.it] INFO: Saving data for 1989038: {'created_time': 1774629431.561663, 'last_price_update_time': 1774629431.561676, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989038') HTTP/1.1" 204 0
2026-03-27 16:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 643e4064-cf92-549c-bf5c-480cecac0cce with identifier: 1989037
2026-03-27 16:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 643e4064-cf92-549c-bf5c-480cecac0cce with identifier: 1989037
2026-03-27 16:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 643e4064-cf92-549c-bf5c-480cecac0cce with identifier: 1989037 to the API
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '643e4064-cf92-549c-bf5c-480cecac0cce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT TIPO CONSIP13 1.3 MJT 95CV 5M S&S POP FP',
'odometer': 127673,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 66,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620362,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620362,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658016,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643e4064-cf92-549c-bf5c-480cecac0cce/643e4064-cf92-549c-bf5c-480cecac0cce_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd2/d4a0dfa2e8594710876d61bcd4fbdbed/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT TIPO CONSIP13 1.3 MJT 95CV 5M S&S POP FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989037%27 HTTP/1.1" 200 None
2026-03-27 16:37:11 [ayvens.it] INFO: Saving data for 1989037: {'created_time': 1774629431.923312, 'last_price_update_time': 1774629431.923322, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989037') HTTP/1.1" 204 0
2026-03-27 16:37:11 [ayvens.it] INFO: Found listing with ID: 1984704
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984704%27 HTTP/1.1" 200 None
2026-03-27 16:37:11 [ayvens.it] INFO: Scrape type for 1984704: 2
2026-03-27 16:37:11 [ayvens.it] INFO: Extracting data for car ID: 1984704
2026-03-27 16:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3416af-234d-5cf7-8172-f187cd7679df with identifier: 1984704
2026-03-27 16:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3416af-234d-5cf7-8172-f187cd7679df with scrape type 2
2026-03-27 16:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc3416af-234d-5cf7-8172-f187cd7679df with scrape type 2
2026-03-27 16:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cc3416af-234d-5cf7-8172-f187cd7679df, identifier: 1984704
2026-03-27 16:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cc3416af-234d-5cf7-8172-f187cd7679df with identifier: 1984704
2026-03-27 16:37:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cc3416af-234d-5cf7-8172-f187cd7679df with identifier: 1984704
2026-03-27 16:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cc3416af-234d-5cf7-8172-f187cd7679df with identifier: 1984704 to the API
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIS ALUMINIUM MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': 'cc3416af-234d-5cf7-8172-f187cd7679df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND 1.2 130CV ELEGANCE S&S AT6',
'odometer': 107738,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND 1.2 130CV ELEGANCE S&S AT6 -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984704%27 HTTP/1.1" 200 None
2026-03-27 16:37:12 [ayvens.it] INFO: Saving data for 1984704: {'auction_closing_time': 1774859400.0, 'created_time': 1774542679.064319, 'last_price_update_time': 1774629432.317401}
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984704') HTTP/1.1" 204 0
2026-03-27 16:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c48a50>
2026-03-27 16:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/7.jpg saved to cache
2026-03-27 16:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b55ed0>
2026-03-27 16:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/8.jpg saved to cache
2026-03-27 16:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:37:12 [ayvens.it] INFO: Found listing with ID: 1984705
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984705%27 HTTP/1.1" 200 None
2026-03-27 16:37:12 [ayvens.it] INFO: Scrape type for 1984705: 2
2026-03-27 16:37:12 [ayvens.it] INFO: Extracting data for car ID: 1984705
2026-03-27 16:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8dfb501-6797-504d-b6a7-92a71b273ded with identifier: 1984705
2026-03-27 16:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8dfb501-6797-504d-b6a7-92a71b273ded with scrape type 2
2026-03-27 16:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8dfb501-6797-504d-b6a7-92a71b273ded with scrape type 2
2026-03-27 16:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c8dfb501-6797-504d-b6a7-92a71b273ded, identifier: 1984705
2026-03-27 16:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c8dfb501-6797-504d-b6a7-92a71b273ded with identifier: 1984705
2026-03-27 16:37:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c8dfb501-6797-504d-b6a7-92a71b273ded with identifier: 1984705
2026-03-27 16:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c8dfb501-6797-504d-b6a7-92a71b273ded with identifier: 1984705 to the API
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SAGE GREEN METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'c8dfb501-6797-504d-b6a7-92a71b273ded',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MINI',
'model': 'MINI COUNTRYMAN (PC) COOPER S E CLASSIC 4WD AUTOMATICA FP',
'odometer': 110339,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-08',
'seats_number': 5,
'seller_name': None,
'title': 'MINI MINI COUNTRYMAN (PC) COOPER S E CLASSIC 4WD AUTOMATICA FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984705%27 HTTP/1.1" 200 None
2026-03-27 16:37:12 [ayvens.it] INFO: Saving data for 1984705: {'auction_closing_time': 1774859400.0, 'created_time': 1774542681.548498, 'last_price_update_time': 1774629432.931327}
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984705') HTTP/1.1" 204 0
2026-03-27 16:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e685452d0>
2026-03-27 16:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp7%252Fde6e3997442344bb920ca25b40e7ef74%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/6.jpg saved to cache
2026-03-27 16:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd
2026-03-27 16:37:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f998d079-ec3b-5c82-98dd-d21e59ea6fbd, skipping ID generation
2026-03-27 16:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd with scrape type 1
2026-03-27 16:37:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f998d079-ec3b-5c82-98dd-d21e59ea6fbd sending to next pipeline
2026-03-27 16:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f998d079-ec3b-5c82-98dd-d21e59ea6fbd, identifier: 1989033
2026-03-27 16:37:13 [ayvens.it] INFO: Found listing with ID: 1984706
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984706%27 HTTP/1.1" 200 None
2026-03-27 16:37:13 [ayvens.it] INFO: Scrape type for 1984706: 2
2026-03-27 16:37:13 [ayvens.it] INFO: Extracting data for car ID: 1984706
2026-03-27 16:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14d721c6-4749-5186-ac24-12158e8fc947 with identifier: 1984706
2026-03-27 16:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d721c6-4749-5186-ac24-12158e8fc947 with scrape type 2
2026-03-27 16:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14d721c6-4749-5186-ac24-12158e8fc947 with scrape type 2
2026-03-27 16:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 14d721c6-4749-5186-ac24-12158e8fc947, identifier: 1984706
2026-03-27 16:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f998d079-ec3b-5c82-98dd-d21e59ea6fbd with identifier: 1989033
2026-03-27 16:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f998d079-ec3b-5c82-98dd-d21e59ea6fbd with identifier: 1989033
2026-03-27 16:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f998d079-ec3b-5c82-98dd-d21e59ea6fbd with identifier: 1989033 to the API
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'f998d079-ec3b-5c82-98dd-d21e59ea6fbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 308 ALLURE BLUEHDI 130 EAT8 S&S AUT. FP',
'odometer': 37212,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 74,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 963049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 963049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 920685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 971305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 983054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 784808,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 659547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f998d079-ec3b-5c82-98dd-d21e59ea6fbd/f998d079-ec3b-5c82-98dd-d21e59ea6fbd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669802,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp7/de6e3997442344bb920ca25b40e7ef74/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 308 ALLURE BLUEHDI 130 EAT8 S&S AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989033%27 HTTP/1.1" 200 None
2026-03-27 16:37:13 [ayvens.it] INFO: Saving data for 1989033: {'created_time': 1774629433.621567, 'last_price_update_time': 1774629433.621576, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989033') HTTP/1.1" 204 0
2026-03-27 16:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 14d721c6-4749-5186-ac24-12158e8fc947 with identifier: 1984706
2026-03-27 16:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 14d721c6-4749-5186-ac24-12158e8fc947 with identifier: 1984706
2026-03-27 16:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 14d721c6-4749-5186-ac24-12158e8fc947 with identifier: 1984706 to the API
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Agate Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '14d721c6-4749-5186-ac24-12158e8fc947',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv Business SW SW 5-door (Euro 6.2)',
'odometer': 160181,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv Business SW SW 5-door (Euro 6.2) '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984706%27 HTTP/1.1" 200 None
2026-03-27 16:37:13 [ayvens.it] INFO: Saving data for 1984706: {'auction_closing_time': 1774859400.0, 'created_time': 1774542682.953923, 'last_price_update_time': 1774629433.870458}
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984706') HTTP/1.1" 204 0
2026-03-27 16:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:13 [ayvens.it] INFO: Found listing with ID: 1984707
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984707%27 HTTP/1.1" 200 None
2026-03-27 16:37:13 [ayvens.it] INFO: Scrape type for 1984707: 2
2026-03-27 16:37:13 [ayvens.it] INFO: Extracting data for car ID: 1984707
2026-03-27 16:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16eb41f9-14eb-57f9-a71f-cd27d92d58c2 with identifier: 1984707
2026-03-27 16:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16eb41f9-14eb-57f9-a71f-cd27d92d58c2 with scrape type 2
2026-03-27 16:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16eb41f9-14eb-57f9-a71f-cd27d92d58c2 with scrape type 2
2026-03-27 16:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 16eb41f9-14eb-57f9-a71f-cd27d92d58c2, identifier: 1984707
2026-03-27 16:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d45050>
2026-03-27 16:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm9%252Fe162c559a5774dbf8576dce5bcc3d120%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/1.jpg saved to cache
2026-03-27 16:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d33a63c-5c27-5117-81af-a392228755c1
2026-03-27 16:37:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d33a63c-5c27-5117-81af-a392228755c1, skipping ID generation
2026-03-27 16:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d33a63c-5c27-5117-81af-a392228755c1 with scrape type 1
2026-03-27 16:37:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d33a63c-5c27-5117-81af-a392228755c1 sending to next pipeline
2026-03-27 16:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6d33a63c-5c27-5117-81af-a392228755c1, identifier: 1989030
2026-03-27 16:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4a4d0>
2026-03-27 16:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/10.jpg saved to cache
2026-03-27 16:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 16eb41f9-14eb-57f9-a71f-cd27d92d58c2 with identifier: 1984707
2026-03-27 16:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 16eb41f9-14eb-57f9-a71f-cd27d92d58c2 with identifier: 1984707
2026-03-27 16:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 16eb41f9-14eb-57f9-a71f-cd27d92d58c2 with identifier: 1984707 to the API
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO FROZEN PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '16eb41f9-14eb-57f9-a71f-cd27d92d58c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT COURIER 1.5 TDCI 100 CV TREND FP',
'odometer': 148521,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT COURIER 1.5 TDCI 100 CV TREND FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984707%27 HTTP/1.1" 200 None
2026-03-27 16:37:14 [ayvens.it] INFO: Saving data for 1984707: {'auction_closing_time': 1774859400.0, 'created_time': 1774542685.194409, 'last_price_update_time': 1774629434.453723}
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984707') HTTP/1.1" 204 0
2026-03-27 16:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6d33a63c-5c27-5117-81af-a392228755c1 with identifier: 1989030
2026-03-27 16:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6d33a63c-5c27-5117-81af-a392228755c1 with identifier: 1989030
2026-03-27 16:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6d33a63c-5c27-5117-81af-a392228755c1 with identifier: 1989030 to the API
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE CELEBES METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '6d33a63c-5c27-5117-81af-a392228755c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ACTIVE PACK FP',
'odometer': 132579,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651028,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505420,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d33a63c-5c27-5117-81af-a392228755c1/6d33a63c-5c27-5117-81af-a392228755c1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457624,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm9/e162c559a5774dbf8576dce5bcc3d120/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ACTIVE PACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989030%27 HTTP/1.1" 200 None
2026-03-27 16:37:14 [ayvens.it] INFO: Saving data for 1989030: {'created_time': 1774629434.790355, 'last_price_update_time': 1774629434.790365, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989030') HTTP/1.1" 204 0
2026-03-27 16:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:14 [ayvens.it] INFO: Found listing with ID: 1984708
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984708%27 HTTP/1.1" 200 None
2026-03-27 16:37:14 [ayvens.it] INFO: Scrape type for 1984708: 2
2026-03-27 16:37:14 [ayvens.it] INFO: Extracting data for car ID: 1984708
2026-03-27 16:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b60019b-d623-5283-84d7-4a3f5358f848 with identifier: 1984708
2026-03-27 16:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b60019b-d623-5283-84d7-4a3f5358f848 with scrape type 2
2026-03-27 16:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b60019b-d623-5283-84d7-4a3f5358f848 with scrape type 2
2026-03-27 16:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2b60019b-d623-5283-84d7-4a3f5358f848, identifier: 1984708
2026-03-27 16:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2b60019b-d623-5283-84d7-4a3f5358f848 with identifier: 1984708
2026-03-27 16:37:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2b60019b-d623-5283-84d7-4a3f5358f848 with identifier: 1984708
2026-03-27 16:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2b60019b-d623-5283-84d7-4a3f5358f848 with identifier: 1984708 to the API
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO MINERALE PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '2b60019b-d623-5283-84d7-4a3f5358f848',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT MASTER FG TA L2 H2 T33 DCI 135 START FP',
'odometer': 140690,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-07',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT MASTER FG TA L2 H2 T33 DCI 135 START FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984708%27 HTTP/1.1" 200 None
2026-03-27 16:37:15 [ayvens.it] INFO: Saving data for 1984708: {'auction_closing_time': 1774859400.0, 'created_time': 1774542698.350457, 'last_price_update_time': 1774629435.23881}
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984708') HTTP/1.1" 204 0
2026-03-27 16:37:15 [ayvens.it] INFO: Found listing with ID: 1984709
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984709%27 HTTP/1.1" 200 None
2026-03-27 16:37:15 [ayvens.it] INFO: Scrape type for 1984709: 2
2026-03-27 16:37:15 [ayvens.it] INFO: Extracting data for car ID: 1984709
2026-03-27 16:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c25ed7d-6f59-58ea-a05c-a6204b4b3174 with identifier: 1984709
2026-03-27 16:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c25ed7d-6f59-58ea-a05c-a6204b4b3174 with scrape type 2
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c25ed7d-6f59-58ea-a05c-a6204b4b3174 with scrape type 2
2026-03-27 16:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5c25ed7d-6f59-58ea-a05c-a6204b4b3174, identifier: 1984709
2026-03-27 16:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5c25ed7d-6f59-58ea-a05c-a6204b4b3174 with identifier: 1984709
2026-03-27 16:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5c25ed7d-6f59-58ea-a05c-a6204b4b3174 with identifier: 1984709
2026-03-27 16:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5c25ed7d-6f59-58ea-a05c-a6204b4b3174 with identifier: 1984709 to the API
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ONYX BLACK MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '5c25ed7d-6f59-58ea-a05c-a6204b4b3174',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 (PC) B4 D AUTOMATICO MOMENTUM PRO FP',
'odometer': 118685,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 (PC) B4 D AUTOMATICO MOMENTUM PRO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984709%27 HTTP/1.1" 200 None
2026-03-27 16:37:15 [ayvens.it] INFO: Saving data for 1984709: {'auction_closing_time': 1774859400.0, 'created_time': 1774542688.011685, 'last_price_update_time': 1774629435.612468}
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984709') HTTP/1.1" 204 0
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c23450>
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/9.jpg saved to cache
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a5cb10>
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/8.jpg saved to cache
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bda550>
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/7.jpg saved to cache
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c20950>
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252Fdc1fe26e63ee407bb76545b71b304141%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/6.jpg saved to cache
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c9aa27c-229c-58e2-a81f-2b969c532067
2026-03-27 16:37:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c9aa27c-229c-58e2-a81f-2b969c532067, skipping ID generation
2026-03-27 16:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c9aa27c-229c-58e2-a81f-2b969c532067 with scrape type 1
2026-03-27 16:37:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c9aa27c-229c-58e2-a81f-2b969c532067 sending to next pipeline
2026-03-27 16:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4c9aa27c-229c-58e2-a81f-2b969c532067, identifier: 1989028
2026-03-27 16:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68500350>
2026-03-27 16:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm0%252F436386a20e3c48f3aa8126bc432e16cf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/8.jpg saved to cache
2026-03-27 16:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22c3f75d-c6c4-5a13-92df-171229b016c2
2026-03-27 16:37:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22c3f75d-c6c4-5a13-92df-171229b016c2, skipping ID generation
2026-03-27 16:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c3f75d-c6c4-5a13-92df-171229b016c2 with scrape type 1
2026-03-27 16:37:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22c3f75d-c6c4-5a13-92df-171229b016c2 sending to next pipeline
2026-03-27 16:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 22c3f75d-c6c4-5a13-92df-171229b016c2, identifier: 1989029
2026-03-27 16:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68541950>
2026-03-27 16:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcc3b009eaa1846b3b05353626ff01ae9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/7.jpg saved to cache
2026-03-27 16:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2976a72-015c-541b-838a-2bb991e3f666
2026-03-27 16:37:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2976a72-015c-541b-838a-2bb991e3f666, skipping ID generation
2026-03-27 16:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2976a72-015c-541b-838a-2bb991e3f666 with scrape type 1
2026-03-27 16:37:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2976a72-015c-541b-838a-2bb991e3f666 sending to next pipeline
2026-03-27 16:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c2976a72-015c-541b-838a-2bb991e3f666, identifier: 1989027
2026-03-27 16:37:16 [ayvens.it] INFO: Found listing with ID: 1984710
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984710%27 HTTP/1.1" 200 None
2026-03-27 16:37:16 [ayvens.it] INFO: Scrape type for 1984710: 2
2026-03-27 16:37:16 [ayvens.it] INFO: Extracting data for car ID: 1984710
2026-03-27 16:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64617e91-439a-54ae-b320-30457d79b5f3 with identifier: 1984710
2026-03-27 16:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64617e91-439a-54ae-b320-30457d79b5f3 with scrape type 2
2026-03-27 16:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64617e91-439a-54ae-b320-30457d79b5f3 with scrape type 2
2026-03-27 16:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 64617e91-439a-54ae-b320-30457d79b5f3, identifier: 1984710
2026-03-27 16:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4c9aa27c-229c-58e2-a81f-2b969c532067 with identifier: 1989028
2026-03-27 16:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4c9aa27c-229c-58e2-a81f-2b969c532067 with identifier: 1989028
2026-03-27 16:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4c9aa27c-229c-58e2-a81f-2b969c532067 with identifier: 1989028 to the API
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '4c9aa27c-229c-58e2-a81f-2b969c532067',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 208 Active Pack PureTech 75 S/S Hatchback 5-door (Euro 6D)',
'odometer': 59740,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 833426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810819,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 833426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774367,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569758,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9aa27c-229c-58e2-a81f-2b969c532067/4c9aa27c-229c-58e2-a81f-2b969c532067_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/dc1fe26e63ee407bb76545b71b304141/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 208 Active Pack PureTech 75 S/S Hatchback 5-door '
'(Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989028%27 HTTP/1.1" 200 None
2026-03-27 16:37:16 [ayvens.it] INFO: Saving data for 1989028: {'created_time': 1774629436.858805, 'last_price_update_time': 1774629436.858817, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989028') HTTP/1.1" 204 0
2026-03-27 16:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 22c3f75d-c6c4-5a13-92df-171229b016c2 with identifier: 1989029
2026-03-27 16:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 22c3f75d-c6c4-5a13-92df-171229b016c2 with identifier: 1989029
2026-03-27 16:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 22c3f75d-c6c4-5a13-92df-171229b016c2 with identifier: 1989029 to the API
2026-03-27 16:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '22c3f75d-c6c4-5a13-92df-171229b016c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP',
'odometer': 189462,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624976,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644247,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631400,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c3f75d-c6c4-5a13-92df-171229b016c2/22c3f75d-c6c4-5a13-92df-171229b016c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm0/436386a20e3c48f3aa8126bc432e16cf/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989029%27 HTTP/1.1" 200 None
2026-03-27 16:37:17 [ayvens.it] INFO: Saving data for 1989029: {'created_time': 1774629437.237543, 'last_price_update_time': 1774629437.237555, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989029') HTTP/1.1" 204 0
2026-03-27 16:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c2976a72-015c-541b-838a-2bb991e3f666 with identifier: 1989027
2026-03-27 16:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c2976a72-015c-541b-838a-2bb991e3f666 with identifier: 1989027
2026-03-27 16:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c2976a72-015c-541b-838a-2bb991e3f666 with identifier: 1989027 to the API
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'c2976a72-015c-541b-838a-2bb991e3f666',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) FP',
'odometer': 85877,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608169,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608169,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581866,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538561,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2976a72-015c-541b-838a-2bb991e3f666/c2976a72-015c-541b-838a-2bb991e3f666_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496210,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cc3b009eaa1846b3b05353626ff01ae9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989027%27 HTTP/1.1" 200 None
2026-03-27 16:37:17 [ayvens.it] INFO: Saving data for 1989027: {'created_time': 1774629437.614541, 'last_price_update_time': 1774629437.614551, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989027') HTTP/1.1" 204 0
2026-03-27 16:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 64617e91-439a-54ae-b320-30457d79b5f3 with identifier: 1984710
2026-03-27 16:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 64617e91-439a-54ae-b320-30457d79b5f3 with identifier: 1984710
2026-03-27 16:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 64617e91-439a-54ae-b320-30457d79b5f3 with identifier: 1984710 to the API
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FUJI WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '64617e91-439a-54ae-b320-30457d79b5f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 MHEV SE AWD auto Sport '
'utility vehicle 5-door (Euro 6D)',
'odometer': 47759,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-15',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVOQUE 2.0 D163 MHEV SE AWD auto '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984710%27 HTTP/1.1" 200 None
2026-03-27 16:37:17 [ayvens.it] INFO: Saving data for 1984710: {'auction_closing_time': 1774859400.0, 'created_time': 1774542693.65185, 'last_price_update_time': 1774629437.870999}
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984710') HTTP/1.1" 204 0
2026-03-27 16:37:17 [ayvens.it] INFO: Found listing with ID: 1984711
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984711%27 HTTP/1.1" 200 None
2026-03-27 16:37:17 [ayvens.it] INFO: Scrape type for 1984711: 2
2026-03-27 16:37:17 [ayvens.it] INFO: Extracting data for car ID: 1984711
2026-03-27 16:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1812309b-c3a6-5853-85c4-f05fcae1b80a with identifier: 1984711
2026-03-27 16:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1812309b-c3a6-5853-85c4-f05fcae1b80a with scrape type 2
2026-03-27 16:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1812309b-c3a6-5853-85c4-f05fcae1b80a with scrape type 2
2026-03-27 16:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1812309b-c3a6-5853-85c4-f05fcae1b80a, identifier: 1984711
2026-03-27 16:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1812309b-c3a6-5853-85c4-f05fcae1b80a with identifier: 1984711
2026-03-27 16:37:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1812309b-c3a6-5853-85c4-f05fcae1b80a with identifier: 1984711
2026-03-27 16:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1812309b-c3a6-5853-85c4-f05fcae1b80a with identifier: 1984711 to the API
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DENIM BLU METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '1812309b-c3a6-5853-85c4-f05fcae1b80a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 T8 PLUG-IN AWD AUTO RECHARGE INSCR. FP',
'odometer': 117847,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-22',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 T8 PLUG-IN AWD AUTO RECHARGE INSCR. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984711%27 HTTP/1.1" 200 None
2026-03-27 16:37:18 [ayvens.it] INFO: Saving data for 1984711: {'auction_closing_time': 1774859400.0, 'created_time': 1774542694.919029, 'last_price_update_time': 1774629438.297413}
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984711') HTTP/1.1" 204 0
2026-03-27 16:37:18 [ayvens.it] INFO: Found listing with ID: 1984712
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984712%27 HTTP/1.1" 200 None
2026-03-27 16:37:18 [ayvens.it] INFO: Scrape type for 1984712: 2
2026-03-27 16:37:18 [ayvens.it] INFO: Extracting data for car ID: 1984712
2026-03-27 16:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2a8ca0-2a04-5e06-bba6-fa08be755535 with identifier: 1984712
2026-03-27 16:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2a8ca0-2a04-5e06-bba6-fa08be755535 with scrape type 2
2026-03-27 16:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2a8ca0-2a04-5e06-bba6-fa08be755535 with scrape type 2
2026-03-27 16:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6f2a8ca0-2a04-5e06-bba6-fa08be755535, identifier: 1984712
2026-03-27 16:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6f2a8ca0-2a04-5e06-bba6-fa08be755535 with identifier: 1984712
2026-03-27 16:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6f2a8ca0-2a04-5e06-bba6-fa08be755535 with identifier: 1984712
2026-03-27 16:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6f2a8ca0-2a04-5e06-bba6-fa08be755535 with identifier: 1984712 to the API
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARTIC WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.3L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '6f2a8ca0-2a04-5e06-bba6-fa08be755535',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MAZDA',
'model': 'MAZDA CX-60 3.3L e-SKYACTIV MHEV Excl. Line Auto Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 25,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-07',
'seats_number': 5,
'seller_name': None,
'title': 'MAZDA MAZDA CX-60 3.3L e-SKYACTIV MHEV Excl. Line Auto Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2025}
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984712%27 HTTP/1.1" 200 None
2026-03-27 16:37:18 [ayvens.it] INFO: Saving data for 1984712: {'auction_closing_time': 1774859400.0, 'created_time': 1774542692.866412, 'last_price_update_time': 1774629438.656613}
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984712') HTTP/1.1" 204 0
2026-03-27 16:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:18 [ayvens.it] INFO: Found listing with ID: 1984713
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984713%27 HTTP/1.1" 200 None
2026-03-27 16:37:18 [ayvens.it] INFO: Scrape type for 1984713: 2
2026-03-27 16:37:18 [ayvens.it] INFO: Extracting data for car ID: 1984713
2026-03-27 16:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d8052c0-64bd-53e2-b895-3a9f40ec5c58 with identifier: 1984713
2026-03-27 16:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d8052c0-64bd-53e2-b895-3a9f40ec5c58 with scrape type 2
2026-03-27 16:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d8052c0-64bd-53e2-b895-3a9f40ec5c58 with scrape type 2
2026-03-27 16:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2d8052c0-64bd-53e2-b895-3a9f40ec5c58, identifier: 1984713
2026-03-27 16:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2d8052c0-64bd-53e2-b895-3a9f40ec5c58 with identifier: 1984713
2026-03-27 16:37:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2d8052c0-64bd-53e2-b895-3a9f40ec5c58 with identifier: 1984713
2026-03-27 16:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2d8052c0-64bd-53e2-b895-3a9f40ec5c58 with identifier: 1984713 to the API
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Rosso Passione pastello',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '2d8052c0-64bd-53e2-b895-3a9f40ec5c58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 1.0 70cv Ibrido Hatchback 3-door',
'odometer': 20895,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 1.0 70cv Ibrido Hatchback 3-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984713%27 HTTP/1.1" 200 None
2026-03-27 16:37:19 [ayvens.it] INFO: Saving data for 1984713: {'auction_closing_time': 1774859400.0, 'created_time': 1774542692.564164, 'last_price_update_time': 1774629439.02071}
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984713') HTTP/1.1" 204 0
2026-03-27 16:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:19 [ayvens.it] INFO: Found listing with ID: 1984714
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984714%27 HTTP/1.1" 200 None
2026-03-27 16:37:19 [ayvens.it] INFO: Scrape type for 1984714: 2
2026-03-27 16:37:19 [ayvens.it] INFO: Extracting data for car ID: 1984714
2026-03-27 16:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d9a861c-7ff7-534e-80d6-671afd8de506 with identifier: 1984714
2026-03-27 16:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d9a861c-7ff7-534e-80d6-671afd8de506 with scrape type 2
2026-03-27 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d9a861c-7ff7-534e-80d6-671afd8de506 with scrape type 2
2026-03-27 16:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2d9a861c-7ff7-534e-80d6-671afd8de506, identifier: 1984714
2026-03-27 16:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2d9a861c-7ff7-534e-80d6-671afd8de506 with identifier: 1984714
2026-03-27 16:37:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2d9a861c-7ff7-534e-80d6-671afd8de506 with identifier: 1984714
2026-03-27 16:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2d9a861c-7ff7-534e-80d6-671afd8de506 with identifier: 1984714 to the API
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO DAYTONA PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '2d9a861c-7ff7-534e-80d6-671afd8de506',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 55 TFSI E IDENTITY BLACK QUATTRO S TRON. FP',
'odometer': 51051,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 55 TFSI E IDENTITY BLACK QUATTRO S TRON. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984714%27 HTTP/1.1" 200 None
2026-03-27 16:37:19 [ayvens.it] INFO: Saving data for 1984714: {'auction_closing_time': 1774859400.0, 'created_time': 1774542694.59698, 'last_price_update_time': 1774629439.380016}
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984714') HTTP/1.1" 204 0
2026-03-27 16:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:19 [ayvens.it] INFO: Found listing with ID: 1984715
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984715%27 HTTP/1.1" 200 None
2026-03-27 16:37:19 [ayvens.it] INFO: Scrape type for 1984715: 2
2026-03-27 16:37:19 [ayvens.it] INFO: Extracting data for car ID: 1984715
2026-03-27 16:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dad4faa-83ba-5dc6-a22c-307e3d4b44f1 with identifier: 1984715
2026-03-27 16:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dad4faa-83ba-5dc6-a22c-307e3d4b44f1 with scrape type 2
2026-03-27 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dad4faa-83ba-5dc6-a22c-307e3d4b44f1 with scrape type 2
2026-03-27 16:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8dad4faa-83ba-5dc6-a22c-307e3d4b44f1, identifier: 1984715
2026-03-27 16:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8dad4faa-83ba-5dc6-a22c-307e3d4b44f1 with identifier: 1984715
2026-03-27 16:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8dad4faa-83ba-5dc6-a22c-307e3d4b44f1 with identifier: 1984715
2026-03-27 16:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8dad4faa-83ba-5dc6-a22c-307e3d4b44f1 with identifier: 1984715 to the API
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '8dad4faa-83ba-5dc6-a22c-307e3d4b44f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP',
'odometer': 108084,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-19',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984715%27 HTTP/1.1" 200 None
2026-03-27 16:37:19 [ayvens.it] INFO: Saving data for 1984715: {'auction_closing_time': 1774859400.0, 'created_time': 1774542699.242956, 'last_price_update_time': 1774629439.763328}
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984715') HTTP/1.1" 204 0
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6925ef90>
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/2.jpg saved to cache
2026-03-27 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68a6b610>
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb7%252F85074b224f684b3e9741db441e6678fa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/6.jpg saved to cache
2026-03-27 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd34f0b6-257a-5a1c-855b-71e732d950b0
2026-03-27 16:37:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd34f0b6-257a-5a1c-855b-71e732d950b0, skipping ID generation
2026-03-27 16:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd34f0b6-257a-5a1c-855b-71e732d950b0 with scrape type 1
2026-03-27 16:37:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd34f0b6-257a-5a1c-855b-71e732d950b0 sending to next pipeline
2026-03-27 16:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bd34f0b6-257a-5a1c-855b-71e732d950b0, identifier: 1989023
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca32d0>
2026-03-27 16:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F8d64161bd20e4118a27739877cee27e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/1.jpg saved to cache
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3534b04-592c-5e8b-b8c9-fb5c888da132
2026-03-27 16:37:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3534b04-592c-5e8b-b8c9-fb5c888da132, skipping ID generation
2026-03-27 16:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3534b04-592c-5e8b-b8c9-fb5c888da132 with scrape type 1
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3534b04-592c-5e8b-b8c9-fb5c888da132 sending to next pipeline
2026-03-27 16:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a3534b04-592c-5e8b-b8c9-fb5c888da132, identifier: 1989026
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa18a50>
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/7.jpg saved to cache
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6953eb50>
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl6%252F36b89cab4b7141c0a4bb74eeb49214e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/6.jpg saved to cache
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b
2026-03-27 16:37:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 147811b0-4ce8-53f7-85a2-ab7f36dc892b, skipping ID generation
2026-03-27 16:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b with scrape type 1
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 147811b0-4ce8-53f7-85a2-ab7f36dc892b sending to next pipeline
2026-03-27 16:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 147811b0-4ce8-53f7-85a2-ab7f36dc892b, identifier: 1989012
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ccdb90>
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn4%252F42399cf03ae14d088963c322c7fd53f2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/1.jpg saved to cache
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2a51038-d3b9-526e-aecf-9cdea16374f6
2026-03-27 16:37:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2a51038-d3b9-526e-aecf-9cdea16374f6, skipping ID generation
2026-03-27 16:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a51038-d3b9-526e-aecf-9cdea16374f6 with scrape type 1
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2a51038-d3b9-526e-aecf-9cdea16374f6 sending to next pipeline
2026-03-27 16:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a2a51038-d3b9-526e-aecf-9cdea16374f6, identifier: 1989017
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f04b50>
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl1%252F2087a6d7e0fa40b2bf7afb04ec8b83e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/7.jpg saved to cache
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2
2026-03-27 16:37:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5ee3c2b-809f-502b-99b1-5b0e4512eee2, skipping ID generation
2026-03-27 16:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2 with scrape type 1
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5ee3c2b-809f-502b-99b1-5b0e4512eee2 sending to next pipeline
2026-03-27 16:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a5ee3c2b-809f-502b-99b1-5b0e4512eee2, identifier: 1989018
2026-03-27 16:37:20 [ayvens.it] INFO: Found listing with ID: 1984716
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984716%27 HTTP/1.1" 200 None
2026-03-27 16:37:20 [ayvens.it] INFO: Scrape type for 1984716: 2
2026-03-27 16:37:20 [ayvens.it] INFO: Extracting data for car ID: 1984716
2026-03-27 16:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f1413b-e7bd-5768-8871-aa87a921c5ed with identifier: 1984716
2026-03-27 16:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f1413b-e7bd-5768-8871-aa87a921c5ed with scrape type 2
2026-03-27 16:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3f1413b-e7bd-5768-8871-aa87a921c5ed with scrape type 2
2026-03-27 16:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a3f1413b-e7bd-5768-8871-aa87a921c5ed, identifier: 1984716
2026-03-27 16:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bd34f0b6-257a-5a1c-855b-71e732d950b0 with identifier: 1989023
2026-03-27 16:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bd34f0b6-257a-5a1c-855b-71e732d950b0 with identifier: 1989023
2026-03-27 16:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bd34f0b6-257a-5a1c-855b-71e732d950b0 with identifier: 1989023 to the API
2026-03-27 16:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol_lpg',
'id': 'bd34f0b6-257a-5a1c-855b-71e732d950b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP',
'odometer': 95816,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 754407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674427,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 759758,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622641,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 754407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd34f0b6-257a-5a1c-855b-71e732d950b0/bd34f0b6-257a-5a1c-855b-71e732d950b0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 722230,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb7/85074b224f684b3e9741db441e6678fa/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP14 1.2 69 CV EASYPOWER E6D-TEMP EASY FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989023%27 HTTP/1.1" 200 None
2026-03-27 16:37:21 [ayvens.it] INFO: Saving data for 1989023: {'created_time': 1774629441.219274, 'last_price_update_time': 1774629441.219287, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989023') HTTP/1.1" 204 0
2026-03-27 16:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a3534b04-592c-5e8b-b8c9-fb5c888da132 with identifier: 1989026
2026-03-27 16:37:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a3534b04-592c-5e8b-b8c9-fb5c888da132 with identifier: 1989026
2026-03-27 16:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a3534b04-592c-5e8b-b8c9-fb5c888da132 with identifier: 1989026 to the API
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO RIFLESSO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'a3534b04-592c-5e8b-b8c9-fb5c888da132',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP',
'odometer': 143331,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 856762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805777,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 856762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 836482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647032,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3534b04-592c-5e8b-b8c9-fb5c888da132/a3534b04-592c-5e8b-b8c9-fb5c888da132_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/8d64161bd20e4118a27739877cee27e9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989026%27 HTTP/1.1" 200 None
2026-03-27 16:37:21 [ayvens.it] INFO: Saving data for 1989026: {'created_time': 1774629441.797555, 'last_price_update_time': 1774629441.797571, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989026') HTTP/1.1" 204 0
2026-03-27 16:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 147811b0-4ce8-53f7-85a2-ab7f36dc892b with identifier: 1989012
2026-03-27 16:37:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 147811b0-4ce8-53f7-85a2-ab7f36dc892b with identifier: 1989012
2026-03-27 16:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 147811b0-4ce8-53f7-85a2-ab7f36dc892b with identifier: 1989012 to the API
2026-03-27 16:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO IBIS',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '147811b0-4ce8-53f7-85a2-ab7f36dc892b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 SPORTBACK PC 40 TDI BUSIN. ADVANCED QUATTRO S TRONIC FP',
'odometer': 82725,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539483,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522757,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568594,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147811b0-4ce8-53f7-85a2-ab7f36dc892b/147811b0-4ce8-53f7-85a2-ab7f36dc892b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl6/36b89cab4b7141c0a4bb74eeb49214e7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 SPORTBACK PC 40 TDI BUSIN. ADVANCED QUATTRO S TRONIC '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989012%27 HTTP/1.1" 200 None
2026-03-27 16:37:22 [ayvens.it] INFO: Saving data for 1989012: {'created_time': 1774629442.434516, 'last_price_update_time': 1774629442.43453, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989012') HTTP/1.1" 204 0
2026-03-27 16:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a2a51038-d3b9-526e-aecf-9cdea16374f6 with identifier: 1989017
2026-03-27 16:37:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a2a51038-d3b9-526e-aecf-9cdea16374f6 with identifier: 1989017
2026-03-27 16:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a2a51038-d3b9-526e-aecf-9cdea16374f6 with identifier: 1989017 to the API
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ICE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'electric',
'id': 'a2a51038-d3b9-526e-aecf-9cdea16374f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 Elettrica Red 118cv Hatchback 3-door',
'odometer': 20336,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644296,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465287,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a51038-d3b9-526e-aecf-9cdea16374f6/a2a51038-d3b9-526e-aecf-9cdea16374f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn4/42399cf03ae14d088963c322c7fd53f2/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 Elettrica Red 118cv Hatchback 3-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989017%27 HTTP/1.1" 200 None
2026-03-27 16:37:22 [ayvens.it] INFO: Saving data for 1989017: {'created_time': 1774629442.851869, 'last_price_update_time': 1774629442.851882, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989017') HTTP/1.1" 204 0
2026-03-27 16:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a5ee3c2b-809f-502b-99b1-5b0e4512eee2 with identifier: 1989018
2026-03-27 16:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a5ee3c2b-809f-502b-99b1-5b0e4512eee2 with identifier: 1989018
2026-03-27 16:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a5ee3c2b-809f-502b-99b1-5b0e4512eee2 with identifier: 1989018 to the API
2026-03-27 16:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SANTORINI BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'a5ee3c2b-809f-502b-99b1-5b0e4512eee2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVOQUE 2.0D I4 163 MHEV AWD auto S Limited '
'Ed. Sport utility vehicle 5-door (Euro 6D)',
'odometer': 157532,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747893,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703335,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594907,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 497933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5ee3c2b-809f-502b-99b1-5b0e4512eee2/a5ee3c2b-809f-502b-99b1-5b0e4512eee2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl1/2087a6d7e0fa40b2bf7afb04ec8b83e0/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVOQUE 2.0D I4 163 MHEV AWD auto '
'S Limited Ed. Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989018%27 HTTP/1.1" 200 None
2026-03-27 16:37:23 [ayvens.it] INFO: Saving data for 1989018: {'created_time': 1774629443.26914, 'last_price_update_time': 1774629443.269151, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989018') HTTP/1.1" 204 0
2026-03-27 16:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a3f1413b-e7bd-5768-8871-aa87a921c5ed with identifier: 1984716
2026-03-27 16:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a3f1413b-e7bd-5768-8871-aa87a921c5ed with identifier: 1984716
2026-03-27 16:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a3f1413b-e7bd-5768-8871-aa87a921c5ed with identifier: 1984716 to the API
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Agate Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'a3f1413b-e7bd-5768-8871-aa87a921c5ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv Business Auto SW SW 5-door (Euro 6.2)',
'odometer': 107643,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-06',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv Business Auto SW SW 5-door (Euro '
'6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984716%27 HTTP/1.1" 200 None
2026-03-27 16:37:23 [ayvens.it] INFO: Saving data for 1984716: {'auction_closing_time': 1774859400.0, 'created_time': 1774542697.446363, 'last_price_update_time': 1774629443.536084}
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984716') HTTP/1.1" 204 0
2026-03-27 16:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b73850>
2026-03-27 16:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F9e2d23926a0949f8a8b97111e06fcb83%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/5.jpg saved to cache
2026-03-27 16:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1
2026-03-27 16:37:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5c4fea4-1b70-5706-b4e8-2ed3056198a1, skipping ID generation
2026-03-27 16:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1 with scrape type 1
2026-03-27 16:37:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5c4fea4-1b70-5706-b4e8-2ed3056198a1 sending to next pipeline
2026-03-27 16:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d5c4fea4-1b70-5706-b4e8-2ed3056198a1, identifier: 1989014
2026-03-27 16:37:23 [ayvens.it] INFO: Found listing with ID: 1984717
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984717%27 HTTP/1.1" 200 None
2026-03-27 16:37:23 [ayvens.it] INFO: Scrape type for 1984717: 2
2026-03-27 16:37:23 [ayvens.it] INFO: Extracting data for car ID: 1984717
2026-03-27 16:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5e41e31-e1a7-5017-ac9a-b818b85488c7 with identifier: 1984717
2026-03-27 16:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5e41e31-e1a7-5017-ac9a-b818b85488c7 with scrape type 2
2026-03-27 16:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5e41e31-e1a7-5017-ac9a-b818b85488c7 with scrape type 2
2026-03-27 16:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d5e41e31-e1a7-5017-ac9a-b818b85488c7, identifier: 1984717
2026-03-27 16:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d5c4fea4-1b70-5706-b4e8-2ed3056198a1 with identifier: 1989014
2026-03-27 16:37:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d5c4fea4-1b70-5706-b4e8-2ed3056198a1 with identifier: 1989014
2026-03-27 16:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d5c4fea4-1b70-5706-b4e8-2ed3056198a1 with identifier: 1989014 to the API
2026-03-27 16:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PURO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'd5c4fea4-1b70-5706-b4e8-2ed3056198a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI SCR ELEGANCE DSG 4MOTION FP',
'odometer': 172425,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 729027,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 722139,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c4fea4-1b70-5706-b4e8-2ed3056198a1/d5c4fea4-1b70-5706-b4e8-2ed3056198a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495388,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/9e2d23926a0949f8a8b97111e06fcb83/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI SCR ELEGANCE DSG '
'4MOTION FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989014%27 HTTP/1.1" 200 None
2026-03-27 16:37:24 [ayvens.it] INFO: Saving data for 1989014: {'created_time': 1774629444.250476, 'last_price_update_time': 1774629444.250487, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989014') HTTP/1.1" 204 0
2026-03-27 16:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d5e41e31-e1a7-5017-ac9a-b818b85488c7 with identifier: 1984717
2026-03-27 16:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d5e41e31-e1a7-5017-ac9a-b818b85488c7 with identifier: 1984717
2026-03-27 16:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d5e41e31-e1a7-5017-ac9a-b818b85488c7 with identifier: 1984717 to the API
2026-03-27 16:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'd5e41e31-e1a7-5017-ac9a-b818b85488c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO (PC) 35 MH1 2.3 MULTIJET 140CV E6D-TEMP',
'odometer': 205788,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO (PC) 35 MH1 2.3 MULTIJET 140CV E6D-TEMP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984717%27 HTTP/1.1" 200 None
2026-03-27 16:37:25 [ayvens.it] INFO: Saving data for 1984717: {'auction_closing_time': 1774859400.0, 'created_time': 1774542700.536702, 'last_price_update_time': 1774629445.36413}
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984717') HTTP/1.1" 204 0
2026-03-27 16:37:25 [ayvens.it] INFO: Found listing with ID: 1984718
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984718%27 HTTP/1.1" 200 None
2026-03-27 16:37:25 [ayvens.it] INFO: Scrape type for 1984718: 2
2026-03-27 16:37:25 [ayvens.it] INFO: Extracting data for car ID: 1984718
2026-03-27 16:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94cb1550-731f-59d8-9490-e28b8e7058e8 with identifier: 1984718
2026-03-27 16:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cb1550-731f-59d8-9490-e28b8e7058e8 with scrape type 2
2026-03-27 16:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94cb1550-731f-59d8-9490-e28b8e7058e8 with scrape type 2
2026-03-27 16:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 94cb1550-731f-59d8-9490-e28b8e7058e8, identifier: 1984718
2026-03-27 16:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 94cb1550-731f-59d8-9490-e28b8e7058e8 with identifier: 1984718
2026-03-27 16:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 94cb1550-731f-59d8-9490-e28b8e7058e8 with identifier: 1984718
2026-03-27 16:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 94cb1550-731f-59d8-9490-e28b8e7058e8 with identifier: 1984718 to the API
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NATURAL WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '94cb1550-731f-59d8-9490-e28b8e7058e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C5 AIRCROSS (PC BLUEHDI 130 S&S C-SERIES EAT8',
'odometer': 45985,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C5 AIRCROSS (PC BLUEHDI 130 S&S C-SERIES EAT8 -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984718%27 HTTP/1.1" 200 None
2026-03-27 16:37:25 [ayvens.it] INFO: Saving data for 1984718: {'auction_closing_time': 1774859400.0, 'created_time': 1774542702.378294, 'last_price_update_time': 1774629445.785375}
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984718') HTTP/1.1" 204 0
2026-03-27 16:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:25 [ayvens.it] INFO: Found listing with ID: 1984719
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984719%27 HTTP/1.1" 200 None
2026-03-27 16:37:25 [ayvens.it] INFO: Scrape type for 1984719: 2
2026-03-27 16:37:25 [ayvens.it] INFO: Extracting data for car ID: 1984719
2026-03-27 16:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85d11d6-32c6-502d-a199-5129903bc60d with identifier: 1984719
2026-03-27 16:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85d11d6-32c6-502d-a199-5129903bc60d with scrape type 2
2026-03-27 16:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d85d11d6-32c6-502d-a199-5129903bc60d with scrape type 2
2026-03-27 16:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d85d11d6-32c6-502d-a199-5129903bc60d, identifier: 1984719
2026-03-27 16:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d85d11d6-32c6-502d-a199-5129903bc60d with identifier: 1984719
2026-03-27 16:37:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d85d11d6-32c6-502d-a199-5129903bc60d with identifier: 1984719
2026-03-27 16:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d85d11d6-32c6-502d-a199-5129903bc60d with identifier: 1984719 to the API
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NARVIK BLACK',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'd85d11d6-32c6-502d-a199-5129903bc60d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180CV S 4WD AUT. FP (PC) FP',
'odometer': 126021,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 180CV S 4WD AUT. FP '
'(PC) FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984719%27 HTTP/1.1" 200 None
2026-03-27 16:37:26 [ayvens.it] INFO: Saving data for 1984719: {'auction_closing_time': 1774859400.0, 'created_time': 1774542703.587022, 'last_price_update_time': 1774629446.35872}
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984719') HTTP/1.1" 204 0
2026-03-27 16:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:26 [ayvens.it] INFO: Found listing with ID: 1984720
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984720%27 HTTP/1.1" 200 None
2026-03-27 16:37:26 [ayvens.it] INFO: Scrape type for 1984720: 2
2026-03-27 16:37:26 [ayvens.it] INFO: Extracting data for car ID: 1984720
2026-03-27 16:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8229d552-1473-5c40-9dca-aa1d1a5bb469 with identifier: 1984720
2026-03-27 16:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8229d552-1473-5c40-9dca-aa1d1a5bb469 with scrape type 2
2026-03-27 16:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8229d552-1473-5c40-9dca-aa1d1a5bb469 with scrape type 2
2026-03-27 16:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8229d552-1473-5c40-9dca-aa1d1a5bb469, identifier: 1984720
2026-03-27 16:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bdb350>
2026-03-27 16:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/10.jpg saved to cache
2026-03-27 16:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8229d552-1473-5c40-9dca-aa1d1a5bb469 with identifier: 1984720
2026-03-27 16:37:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8229d552-1473-5c40-9dca-aa1d1a5bb469 with identifier: 1984720
2026-03-27 16:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8229d552-1473-5c40-9dca-aa1d1a5bb469 with identifier: 1984720 to the API
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PURE WHITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '8229d552-1473-5c40-9dca-aa1d1a5bb469',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF (PC) 1.0 ETSI 81KW EVO LIFE DSG FP',
'odometer': 181235,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF (PC) 1.0 ETSI 81KW EVO LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984720%27 HTTP/1.1" 200 None
2026-03-27 16:37:26 [ayvens.it] INFO: Saving data for 1984720: {'auction_closing_time': 1774859400.0, 'created_time': 1774542705.656801, 'last_price_update_time': 1774629446.871397}
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984720') HTTP/1.1" 204 0
2026-03-27 16:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:26 [ayvens.it] INFO: Found listing with ID: 1984721
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984721%27 HTTP/1.1" 200 None
2026-03-27 16:37:26 [ayvens.it] INFO: Scrape type for 1984721: 2
2026-03-27 16:37:26 [ayvens.it] INFO: Extracting data for car ID: 1984721
2026-03-27 16:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e3a13d1-6bd9-5f01-a51b-a9c580957384 with identifier: 1984721
2026-03-27 16:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e3a13d1-6bd9-5f01-a51b-a9c580957384 with scrape type 2
2026-03-27 16:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e3a13d1-6bd9-5f01-a51b-a9c580957384 with scrape type 2
2026-03-27 16:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6e3a13d1-6bd9-5f01-a51b-a9c580957384, identifier: 1984721
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853e090>
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk8%252F37962c7ade374328a7e149c4bfee9917%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/9.jpg saved to cache
2026-03-27 16:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96b3f6ba-e94e-539f-a450-08c85b1e3306
2026-03-27 16:37:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96b3f6ba-e94e-539f-a450-08c85b1e3306, skipping ID generation
2026-03-27 16:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96b3f6ba-e94e-539f-a450-08c85b1e3306 with scrape type 1
2026-03-27 16:37:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96b3f6ba-e94e-539f-a450-08c85b1e3306 sending to next pipeline
2026-03-27 16:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 96b3f6ba-e94e-539f-a450-08c85b1e3306, identifier: 1989008
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6914cf50>
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fea4c2a6956734c2099b17073217493b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/7.jpg saved to cache
2026-03-27 16:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d19a73cb-0248-50eb-9fea-a78eea5dc241
2026-03-27 16:37:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d19a73cb-0248-50eb-9fea-a78eea5dc241, skipping ID generation
2026-03-27 16:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19a73cb-0248-50eb-9fea-a78eea5dc241 with scrape type 1
2026-03-27 16:37:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d19a73cb-0248-50eb-9fea-a78eea5dc241 sending to next pipeline
2026-03-27 16:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d19a73cb-0248-50eb-9fea-a78eea5dc241, identifier: 1989009
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69454810>
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/9.jpg saved to cache
2026-03-27 16:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6e3a13d1-6bd9-5f01-a51b-a9c580957384 with identifier: 1984721
2026-03-27 16:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6e3a13d1-6bd9-5f01-a51b-a9c580957384 with identifier: 1984721
2026-03-27 16:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6e3a13d1-6bd9-5f01-a51b-a9c580957384 with identifier: 1984721 to the API
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MYTHOS MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '6e3a13d1-6bd9-5f01-a51b-a9c580957384',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 (PC) 50 TFSI E S LINE PLUS QUATTRO S TRONIC FP',
'odometer': 42714,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 (PC) 50 TFSI E S LINE PLUS QUATTRO S TRONIC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984721%27 HTTP/1.1" 200 None
2026-03-27 16:37:27 [ayvens.it] INFO: Saving data for 1984721: {'auction_closing_time': 1774859400.0, 'created_time': 1774542707.78173, 'last_price_update_time': 1774629447.636628}
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984721') HTTP/1.1" 204 0
2026-03-27 16:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 96b3f6ba-e94e-539f-a450-08c85b1e3306 with identifier: 1989008
2026-03-27 16:37:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 96b3f6ba-e94e-539f-a450-08c85b1e3306 with identifier: 1989008
2026-03-27 16:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 96b3f6ba-e94e-539f-a450-08c85b1e3306 with identifier: 1989008 to the API
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Sophisto Grey Brilliant Effect',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '96b3f6ba-e94e-539f-a450-08c85b1e3306',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X3 xDrive 20d MH48V Sport utility vehicle 5-door (Euro 6D)',
'odometer': 84318,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649534,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b3f6ba-e94e-539f-a450-08c85b1e3306/96b3f6ba-e94e-539f-a450-08c85b1e3306_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515954,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk8/37962c7ade374328a7e149c4bfee9917/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X3 xDrive 20d MH48V Sport utility vehicle 5-door (Euro 6D) '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989008%27 HTTP/1.1" 200 None
2026-03-27 16:37:28 [ayvens.it] INFO: Saving data for 1989008: {'created_time': 1774629448.057277, 'last_price_update_time': 1774629448.057287, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989008') HTTP/1.1" 204 0
2026-03-27 16:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d19a73cb-0248-50eb-9fea-a78eea5dc241 with identifier: 1989009
2026-03-27 16:37:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d19a73cb-0248-50eb-9fea-a78eea5dc241 with identifier: 1989009
2026-03-27 16:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d19a73cb-0248-50eb-9fea-a78eea5dc241 with identifier: 1989009 to the API
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blu Navarra metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'd19a73cb-0248-50eb-9fea-a78eea5dc241',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 30 TFSI S tronic S line Edition S.Back Hatchback 5-door '
'(Euro 6D)',
'odometer': 17618,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 62,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546764,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572194,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19a73cb-0248-50eb-9fea-a78eea5dc241/d19a73cb-0248-50eb-9fea-a78eea5dc241_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/ea4c2a6956734c2099b17073217493b9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 30 TFSI S tronic S line Edition S.Back Hatchback '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989009%27 HTTP/1.1" 200 None
2026-03-27 16:37:28 [ayvens.it] INFO: Saving data for 1989009: {'created_time': 1774629448.453346, 'last_price_update_time': 1774629448.453356, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989009') HTTP/1.1" 204 0
2026-03-27 16:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:28 [ayvens.it] INFO: Found listing with ID: 1984722
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984722%27 HTTP/1.1" 200 None
2026-03-27 16:37:28 [ayvens.it] INFO: Scrape type for 1984722: 2
2026-03-27 16:37:28 [ayvens.it] INFO: Extracting data for car ID: 1984722
2026-03-27 16:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5596e0cd-25eb-5635-9f02-a7068f23705e with identifier: 1984722
2026-03-27 16:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5596e0cd-25eb-5635-9f02-a7068f23705e with scrape type 2
2026-03-27 16:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5596e0cd-25eb-5635-9f02-a7068f23705e with scrape type 2
2026-03-27 16:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5596e0cd-25eb-5635-9f02-a7068f23705e, identifier: 1984722
2026-03-27 16:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5596e0cd-25eb-5635-9f02-a7068f23705e with identifier: 1984722
2026-03-27 16:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5596e0cd-25eb-5635-9f02-a7068f23705e with identifier: 1984722
2026-03-27 16:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5596e0cd-25eb-5635-9f02-a7068f23705e with identifier: 1984722 to the API
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'LUCID RED METALLIZZATO PREMIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '5596e0cd-25eb-5635-9f02-a7068f23705e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 EcoBlue 120CV 2WD ST-Line X Auto',
'odometer': 127878,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 EcoBlue 120CV 2WD ST-Line X Auto -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984722%27 HTTP/1.1" 200 None
2026-03-27 16:37:28 [ayvens.it] INFO: Saving data for 1984722: {'auction_closing_time': 1774859400.0, 'created_time': 1774542709.161731, 'last_price_update_time': 1774629448.804891}
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984722') HTTP/1.1" 204 0
2026-03-27 16:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691cae10>
2026-03-27 16:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk7%252Fb22ea3ed879e46889bf303ca2e1f8676%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/6.jpg saved to cache
2026-03-27 16:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8bbf80b-53c9-5456-a0de-ba8d60874d64
2026-03-27 16:37:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8bbf80b-53c9-5456-a0de-ba8d60874d64, skipping ID generation
2026-03-27 16:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bbf80b-53c9-5456-a0de-ba8d60874d64 with scrape type 1
2026-03-27 16:37:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8bbf80b-53c9-5456-a0de-ba8d60874d64 sending to next pipeline
2026-03-27 16:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a8bbf80b-53c9-5456-a0de-ba8d60874d64, identifier: 1989011
2026-03-27 16:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d1ff10>
2026-03-27 16:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn9%252F08e74b3365f4440f82458f792cb9577c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/2.jpg saved to cache
2026-03-27 16:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09ec88cd-4db4-50af-b5c4-9a4681354f66
2026-03-27 16:37:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09ec88cd-4db4-50af-b5c4-9a4681354f66, skipping ID generation
2026-03-27 16:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ec88cd-4db4-50af-b5c4-9a4681354f66 with scrape type 1
2026-03-27 16:37:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09ec88cd-4db4-50af-b5c4-9a4681354f66 sending to next pipeline
2026-03-27 16:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 09ec88cd-4db4-50af-b5c4-9a4681354f66, identifier: 1988984
2026-03-27 16:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690729d0>
2026-03-27 16:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/3.jpg saved to cache
2026-03-27 16:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:37:29 [ayvens.it] INFO: Found listing with ID: 1984723
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984723%27 HTTP/1.1" 200 None
2026-03-27 16:37:29 [ayvens.it] INFO: Scrape type for 1984723: 2
2026-03-27 16:37:29 [ayvens.it] INFO: Extracting data for car ID: 1984723
2026-03-27 16:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c55da13-a3d4-5ba1-84a5-11f1aeee0208 with identifier: 1984723
2026-03-27 16:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c55da13-a3d4-5ba1-84a5-11f1aeee0208 with scrape type 2
2026-03-27 16:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c55da13-a3d4-5ba1-84a5-11f1aeee0208 with scrape type 2
2026-03-27 16:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5c55da13-a3d4-5ba1-84a5-11f1aeee0208, identifier: 1984723
2026-03-27 16:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a8bbf80b-53c9-5456-a0de-ba8d60874d64 with identifier: 1989011
2026-03-27 16:37:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a8bbf80b-53c9-5456-a0de-ba8d60874d64 with identifier: 1989011
2026-03-27 16:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a8bbf80b-53c9-5456-a0de-ba8d60874d64 with identifier: 1989011 to the API
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'a8bbf80b-53c9-5456-a0de-ba8d60874d64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 B4 D automatico Business Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 148766,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 871923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 871923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 855500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 881645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866629,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707925,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492773,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514565,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580387,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bbf80b-53c9-5456-a0de-ba8d60874d64/a8bbf80b-53c9-5456-a0de-ba8d60874d64_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk7/b22ea3ed879e46889bf303ca2e1f8676/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 B4 D automatico Business Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271989011%27 HTTP/1.1" 200 None
2026-03-27 16:37:29 [ayvens.it] INFO: Saving data for 1989011: {'created_time': 1774629449.775796, 'last_price_update_time': 1774629449.775807, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1989011') HTTP/1.1" 204 0
2026-03-27 16:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 09ec88cd-4db4-50af-b5c4-9a4681354f66 with identifier: 1988984
2026-03-27 16:37:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 09ec88cd-4db4-50af-b5c4-9a4681354f66 with identifier: 1988984
2026-03-27 16:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 09ec88cd-4db4-50af-b5c4-9a4681354f66 with identifier: 1988984 to the API
2026-03-27 16:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Tridion silver metallic',
'currency': 'EUR',
'doors_number': 2,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '09ec88cd-4db4-50af-b5c4-9a4681354f66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SMART',
'model': 'SMART FORTWO COUPÈ 70 1.0 52kW passion twinamic Coupé 3-door',
'odometer': 33204,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663425,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643550,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543690,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ec88cd-4db4-50af-b5c4-9a4681354f66/09ec88cd-4db4-50af-b5c4-9a4681354f66_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn9/08e74b3365f4440f82458f792cb9577c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-02',
'seats_number': 5,
'seller_name': None,
'title': 'SMART SMART FORTWO COUPÈ 70 1.0 52kW passion twinamic Coupé 3-door '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988984%27 HTTP/1.1" 200 None
2026-03-27 16:37:30 [ayvens.it] INFO: Saving data for 1988984: {'created_time': 1774629450.124525, 'last_price_update_time': 1774629450.124537, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988984') HTTP/1.1" 204 0
2026-03-27 16:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5c55da13-a3d4-5ba1-84a5-11f1aeee0208 with identifier: 1984723
2026-03-27 16:37:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5c55da13-a3d4-5ba1-84a5-11f1aeee0208 with identifier: 1984723
2026-03-27 16:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5c55da13-a3d4-5ba1-84a5-11f1aeee0208 with identifier: 1984723 to the API
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PERLA MTZ SPECIALE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '5c55da13-a3d4-5ba1-84a5-11f1aeee0208',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT ARKANA 1.6 HYBRID E-TECH 105KW R.S. LINE',
'odometer': 92474,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-16',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT ARKANA 1.6 HYBRID E-TECH 105KW R.S. LINE -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984723%27 HTTP/1.1" 200 None
2026-03-27 16:37:30 [ayvens.it] INFO: Saving data for 1984723: {'auction_closing_time': 1774859400.0, 'created_time': 1774542711.897051, 'last_price_update_time': 1774629450.385027}
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984723') HTTP/1.1" 204 0
2026-03-27 16:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:30 [ayvens.it] INFO: Found listing with ID: 1984724
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984724%27 HTTP/1.1" 200 None
2026-03-27 16:37:30 [ayvens.it] INFO: Scrape type for 1984724: 2
2026-03-27 16:37:30 [ayvens.it] INFO: Extracting data for car ID: 1984724
2026-03-27 16:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 281a8aa1-bc31-5eec-892c-f3c89cfe166f with identifier: 1984724
2026-03-27 16:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281a8aa1-bc31-5eec-892c-f3c89cfe166f with scrape type 2
2026-03-27 16:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 281a8aa1-bc31-5eec-892c-f3c89cfe166f with scrape type 2
2026-03-27 16:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 281a8aa1-bc31-5eec-892c-f3c89cfe166f, identifier: 1984724
2026-03-27 16:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5c850>
2026-03-27 16:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Few6%252Fec45729a03e646129806b340431a2f29%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/2.jpg saved to cache
2026-03-27 16:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd
2026-03-27 16:37:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46dcf41d-ce60-54eb-8feb-c51c1493aedd, skipping ID generation
2026-03-27 16:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd with scrape type 1
2026-03-27 16:37:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46dcf41d-ce60-54eb-8feb-c51c1493aedd sending to next pipeline
2026-03-27 16:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 46dcf41d-ce60-54eb-8feb-c51c1493aedd, identifier: 1988982
2026-03-27 16:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 281a8aa1-bc31-5eec-892c-f3c89cfe166f with identifier: 1984724
2026-03-27 16:37:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 281a8aa1-bc31-5eec-892c-f3c89cfe166f with identifier: 1984724
2026-03-27 16:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 281a8aa1-bc31-5eec-892c-f3c89cfe166f with identifier: 1984724 to the API
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BRIGHT DUSK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '281a8aa1-bc31-5eec-892c-f3c89cfe166f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO CORE FP',
'odometer': 77418,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO CORE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984724%27 HTTP/1.1" 200 None
2026-03-27 16:37:30 [ayvens.it] INFO: Saving data for 1984724: {'auction_closing_time': 1774859400.0, 'created_time': 1774542712.887203, 'last_price_update_time': 1774629450.937588}
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984724') HTTP/1.1" 204 0
2026-03-27 16:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 46dcf41d-ce60-54eb-8feb-c51c1493aedd with identifier: 1988982
2026-03-27 16:37:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 46dcf41d-ce60-54eb-8feb-c51c1493aedd with identifier: 1988982
2026-03-27 16:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 46dcf41d-ce60-54eb-8feb-c51c1493aedd with identifier: 1988982 to the API
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO',
'currency': 'EUR',
'doors_number': 2,
'engine': '0.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '46dcf41d-ce60-54eb-8feb-c51c1493aedd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT TWEET 125i GT Motociclo (Euro 5)',
'odometer': 15518,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 46,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706564,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706564,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711141,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581735,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46dcf41d-ce60-54eb-8feb-c51c1493aedd/46dcf41d-ce60-54eb-8feb-c51c1493aedd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618307,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ew6/ec45729a03e646129806b340431a2f29/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT TWEET 125i GT Motociclo (Euro 5) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988982%27 HTTP/1.1" 200 None
2026-03-27 16:37:31 [ayvens.it] INFO: Saving data for 1988982: {'created_time': 1774629451.387291, 'last_price_update_time': 1774629451.387303, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988982') HTTP/1.1" 204 0
2026-03-27 16:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:31 [ayvens.it] INFO: Found listing with ID: 1984725
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984725%27 HTTP/1.1" 200 None
2026-03-27 16:37:31 [ayvens.it] INFO: Scrape type for 1984725: 2
2026-03-27 16:37:31 [ayvens.it] INFO: Extracting data for car ID: 1984725
2026-03-27 16:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8121d0-68a5-53e0-a58d-40bc78daf49e with identifier: 1984725
2026-03-27 16:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8121d0-68a5-53e0-a58d-40bc78daf49e with scrape type 2
2026-03-27 16:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a8121d0-68a5-53e0-a58d-40bc78daf49e with scrape type 2
2026-03-27 16:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1a8121d0-68a5-53e0-a58d-40bc78daf49e, identifier: 1984725
2026-03-27 16:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1a8121d0-68a5-53e0-a58d-40bc78daf49e with identifier: 1984725
2026-03-27 16:37:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1a8121d0-68a5-53e0-a58d-40bc78daf49e with identifier: 1984725
2026-03-27 16:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1a8121d0-68a5-53e0-a58d-40bc78daf49e with identifier: 1984725 to the API
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Alfa pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '1a8121d0-68a5-53e0-a58d-40bc78daf49e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO 2.2 TD 190 CV Sprint AT8 Q4 Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 196529,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO 2.2 TD 190 CV Sprint AT8 Q4 Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984725%27 HTTP/1.1" 200 None
2026-03-27 16:37:31 [ayvens.it] INFO: Saving data for 1984725: {'auction_closing_time': 1774859400.0, 'created_time': 1774542713.903005, 'last_price_update_time': 1774629451.745405}
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984725') HTTP/1.1" 204 0
2026-03-27 16:37:31 [ayvens.it] INFO: Found listing with ID: 1984726
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984726%27 HTTP/1.1" 200 None
2026-03-27 16:37:31 [ayvens.it] INFO: Scrape type for 1984726: 2
2026-03-27 16:37:31 [ayvens.it] INFO: Extracting data for car ID: 1984726
2026-03-27 16:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10001891-2c68-5bb9-a621-09f89f0bddc4 with identifier: 1984726
2026-03-27 16:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10001891-2c68-5bb9-a621-09f89f0bddc4 with scrape type 2
2026-03-27 16:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10001891-2c68-5bb9-a621-09f89f0bddc4 with scrape type 2
2026-03-27 16:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 10001891-2c68-5bb9-a621-09f89f0bddc4, identifier: 1984726
2026-03-27 16:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 10001891-2c68-5bb9-a621-09f89f0bddc4 with identifier: 1984726
2026-03-27 16:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 10001891-2c68-5bb9-a621-09f89f0bddc4 with identifier: 1984726
2026-03-27 16:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 10001891-2c68-5bb9-a621-09f89f0bddc4 with identifier: 1984726 to the API
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '10001891-2c68-5bb9-a621-09f89f0bddc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP',
'odometer': 83499,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984726%27 HTTP/1.1" 200 None
2026-03-27 16:37:32 [ayvens.it] INFO: Saving data for 1984726: {'auction_closing_time': 1774859400.0, 'created_time': 1774542716.453147, 'last_price_update_time': 1774629452.173282}
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984726') HTTP/1.1" 204 0
2026-03-27 16:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69072a50>
2026-03-27 16:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer6%252F4ae6855c98f7499aad4d378fab83919a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/5.jpg saved to cache
2026-03-27 16:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70
2026-03-27 16:37:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87ef6e0d-6c29-512b-a8a4-87e3957e5f70, skipping ID generation
2026-03-27 16:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70 with scrape type 1
2026-03-27 16:37:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87ef6e0d-6c29-512b-a8a4-87e3957e5f70 sending to next pipeline
2026-03-27 16:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 87ef6e0d-6c29-512b-a8a4-87e3957e5f70, identifier: 1988981
2026-03-27 16:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69073910>
2026-03-27 16:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj5%252F066875192de4496eada2be994f9fc7cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/1.jpg saved to cache
2026-03-27 16:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843
2026-03-27 16:37:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843, skipping ID generation
2026-03-27 16:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843 with scrape type 1
2026-03-27 16:37:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843 sending to next pipeline
2026-03-27 16:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843, identifier: 1988976
2026-03-27 16:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:32 [ayvens.it] INFO: Found listing with ID: 1984727
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984727%27 HTTP/1.1" 200 None
2026-03-27 16:37:32 [ayvens.it] INFO: Scrape type for 1984727: 2
2026-03-27 16:37:32 [ayvens.it] INFO: Extracting data for car ID: 1984727
2026-03-27 16:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9c3031a-4e38-5507-9bca-96d99ccd2678 with identifier: 1984727
2026-03-27 16:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9c3031a-4e38-5507-9bca-96d99ccd2678 with scrape type 2
2026-03-27 16:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9c3031a-4e38-5507-9bca-96d99ccd2678 with scrape type 2
2026-03-27 16:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d9c3031a-4e38-5507-9bca-96d99ccd2678, identifier: 1984727
2026-03-27 16:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 87ef6e0d-6c29-512b-a8a4-87e3957e5f70 with identifier: 1988981
2026-03-27 16:37:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 87ef6e0d-6c29-512b-a8a4-87e3957e5f70 with identifier: 1988981
2026-03-27 16:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 87ef6e0d-6c29-512b-a8a4-87e3957e5f70 with identifier: 1988981 to the API
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SONIC GREY',
'currency': 'EUR',
'doors_number': 2,
'engine': '0.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '87ef6e0d-6c29-512b-a8a4-87e3957e5f70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'YAMAHA',
'model': 'YAMAHA XMAX 300 ABS Motociclo (Euro 4)',
'odometer': 68661,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590947,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600047,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ef6e0d-6c29-512b-a8a4-87e3957e5f70/87ef6e0d-6c29-512b-a8a4-87e3957e5f70_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er6/4ae6855c98f7499aad4d378fab83919a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-20',
'seats_number': 5,
'seller_name': None,
'title': 'YAMAHA YAMAHA XMAX 300 ABS Motociclo (Euro 4) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988981%27 HTTP/1.1" 200 None
2026-03-27 16:37:33 [ayvens.it] INFO: Saving data for 1988981: {'created_time': 1774629453.063541, 'last_price_update_time': 1774629453.063553, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988981') HTTP/1.1" 204 0
2026-03-27 16:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843 with identifier: 1988976
2026-03-27 16:37:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843 with identifier: 1988976
2026-03-27 16:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5f3eb371-bd11-5b37-ab8e-b59f5a9cb843 with identifier: 1988976 to the API
2026-03-27 16:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Christal White Pearl metallizz',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '5f3eb371-bd11-5b37-ab8e-b59f5a9cb843',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO V60 B4 D autom. Momentum Business SW 5-door (Euro 6D)',
'odometer': 139127,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3eb371-bd11-5b37-ab8e-b59f5a9cb843/5f3eb371-bd11-5b37-ab8e-b59f5a9cb843_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj5/066875192de4496eada2be994f9fc7cf/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO V60 B4 D autom. Momentum Business SW 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988976%27 HTTP/1.1" 200 None
2026-03-27 16:37:34 [ayvens.it] INFO: Saving data for 1988976: {'created_time': 1774629454.567402, 'last_price_update_time': 1774629454.567413, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988976') HTTP/1.1" 204 0
2026-03-27 16:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d9c3031a-4e38-5507-9bca-96d99ccd2678 with identifier: 1984727
2026-03-27 16:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d9c3031a-4e38-5507-9bca-96d99ccd2678 with identifier: 1984727
2026-03-27 16:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d9c3031a-4e38-5507-9bca-96d99ccd2678 with identifier: 1984727 to the API
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ALPINE WHITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'd9c3031a-4e38-5507-9bca-96d99ccd2678',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP RENEGADE CONSIP 1.3 T4 PHEV 190CV LIMITED 4XE AUTO FP',
'odometer': 34593,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP RENEGADE CONSIP 1.3 T4 PHEV 190CV LIMITED 4XE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984727%27 HTTP/1.1" 200 None
2026-03-27 16:37:34 [ayvens.it] INFO: Saving data for 1984727: {'auction_closing_time': 1774859400.0, 'created_time': 1774542717.57053, 'last_price_update_time': 1774629454.835054}
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984727') HTTP/1.1" 204 0
2026-03-27 16:37:34 [ayvens.it] INFO: Found listing with ID: 1984728
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984728%27 HTTP/1.1" 200 None
2026-03-27 16:37:34 [ayvens.it] INFO: Scrape type for 1984728: 2
2026-03-27 16:37:34 [ayvens.it] INFO: Extracting data for car ID: 1984728
2026-03-27 16:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee8746a0-6a28-596d-a655-87023765cef5 with identifier: 1984728
2026-03-27 16:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee8746a0-6a28-596d-a655-87023765cef5 with scrape type 2
2026-03-27 16:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee8746a0-6a28-596d-a655-87023765cef5 with scrape type 2
2026-03-27 16:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ee8746a0-6a28-596d-a655-87023765cef5, identifier: 1984728
2026-03-27 16:37:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c6a2d0>
2026-03-27 16:37:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm8%252F1677c7f09cbb4cf0a59fec37a3d7a102%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/1.jpg saved to cache
2026-03-27 16:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96fc3907-28cd-5237-9d60-20203660740f
2026-03-27 16:37:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96fc3907-28cd-5237-9d60-20203660740f, skipping ID generation
2026-03-27 16:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96fc3907-28cd-5237-9d60-20203660740f with scrape type 1
2026-03-27 16:37:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96fc3907-28cd-5237-9d60-20203660740f sending to next pipeline
2026-03-27 16:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 96fc3907-28cd-5237-9d60-20203660740f, identifier: 1988978
2026-03-27 16:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69018850>
2026-03-27 16:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/7.jpg saved to cache
2026-03-27 16:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ee8746a0-6a28-596d-a655-87023765cef5 with identifier: 1984728
2026-03-27 16:37:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ee8746a0-6a28-596d-a655-87023765cef5 with identifier: 1984728
2026-03-27 16:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ee8746a0-6a28-596d-a655-87023765cef5 with identifier: 1984728 to the API
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRAPHITE GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'ee8746a0-6a28-596d-a655-87023765cef5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP RENEGADE 1.5 T4 MHEV 130CV LIMITED DDCT FP',
'odometer': 106022,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP RENEGADE 1.5 T4 MHEV 130CV LIMITED DDCT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984728%27 HTTP/1.1" 200 None
2026-03-27 16:37:35 [ayvens.it] INFO: Saving data for 1984728: {'auction_closing_time': 1774859400.0, 'created_time': 1774542718.841684, 'last_price_update_time': 1774629455.431427}
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984728') HTTP/1.1" 204 0
2026-03-27 16:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 96fc3907-28cd-5237-9d60-20203660740f with identifier: 1988978
2026-03-27 16:37:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 96fc3907-28cd-5237-9d60-20203660740f with identifier: 1988978
2026-03-27 16:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 96fc3907-28cd-5237-9d60-20203660740f with identifier: 1988978 to the API
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio Scisto metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '96fc3907-28cd-5237-9d60-20203660740f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT CLIO 1.0 TCE 66KW EQUILIBRE Hatchback 5-door (Euro 6D)',
'odometer': 88624,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 64,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407759,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447097,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365443,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fc3907-28cd-5237-9d60-20203660740f/96fc3907-28cd-5237-9d60-20203660740f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm8/1677c7f09cbb4cf0a59fec37a3d7a102/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT CLIO 1.0 TCE 66KW EQUILIBRE Hatchback 5-door (Euro '
'6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988978%27 HTTP/1.1" 200 None
2026-03-27 16:37:35 [ayvens.it] INFO: Saving data for 1988978: {'created_time': 1774629455.786989, 'last_price_update_time': 1774629455.787001, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988978') HTTP/1.1" 204 0
2026-03-27 16:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:35 [ayvens.it] INFO: Found listing with ID: 1984729
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984729%27 HTTP/1.1" 200 None
2026-03-27 16:37:35 [ayvens.it] INFO: Scrape type for 1984729: 2
2026-03-27 16:37:35 [ayvens.it] INFO: Extracting data for car ID: 1984729
2026-03-27 16:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 955eef84-274e-5069-964c-1b6c1cd9e646 with identifier: 1984729
2026-03-27 16:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 955eef84-274e-5069-964c-1b6c1cd9e646 with scrape type 2
2026-03-27 16:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 955eef84-274e-5069-964c-1b6c1cd9e646 with scrape type 2
2026-03-27 16:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 955eef84-274e-5069-964c-1b6c1cd9e646, identifier: 1984729
2026-03-27 16:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68954c10>
2026-03-27 16:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/6.jpg saved to cache
2026-03-27 16:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b33710>
2026-03-27 16:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/4.jpg saved to cache
2026-03-27 16:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69454a90>
2026-03-27 16:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/3.jpg saved to cache
2026-03-27 16:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 955eef84-274e-5069-964c-1b6c1cd9e646 with identifier: 1984729
2026-03-27 16:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 955eef84-274e-5069-964c-1b6c1cd9e646 with identifier: 1984729
2026-03-27 16:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 955eef84-274e-5069-964c-1b6c1cd9e646 with identifier: 1984729 to the API
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '955eef84-274e-5069-964c-1b6c1cd9e646',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 115995,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984729%27 HTTP/1.1" 200 None
2026-03-27 16:37:36 [ayvens.it] INFO: Saving data for 1984729: {'auction_closing_time': 1774859400.0, 'created_time': 1774542720.580527, 'last_price_update_time': 1774629456.585607}
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984729') HTTP/1.1" 204 0
2026-03-27 16:37:36 [ayvens.it] INFO: Found listing with ID: 1984730
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984730%27 HTTP/1.1" 200 None
2026-03-27 16:37:36 [ayvens.it] INFO: Scrape type for 1984730: 2
2026-03-27 16:37:36 [ayvens.it] INFO: Extracting data for car ID: 1984730
2026-03-27 16:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f20595ca-4d36-5416-ab26-48ba948de055 with identifier: 1984730
2026-03-27 16:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f20595ca-4d36-5416-ab26-48ba948de055 with scrape type 2
2026-03-27 16:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f20595ca-4d36-5416-ab26-48ba948de055 with scrape type 2
2026-03-27 16:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f20595ca-4d36-5416-ab26-48ba948de055, identifier: 1984730
2026-03-27 16:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f20595ca-4d36-5416-ab26-48ba948de055 with identifier: 1984730
2026-03-27 16:37:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f20595ca-4d36-5416-ab26-48ba948de055 with identifier: 1984730
2026-03-27 16:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f20595ca-4d36-5416-ab26-48ba948de055 with identifier: 1984730 to the API
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'f20595ca-4d36-5416-ab26-48ba948de055',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER VELAR 2.0 D I4 204 R-Dynamic S 4WD Auto '
'Sport utility vehicle 5-door (Euro 6D)',
'odometer': 84669,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER VELAR 2.0 D I4 204 R-Dynamic S '
'4WD Auto Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984730%27 HTTP/1.1" 200 None
2026-03-27 16:37:36 [ayvens.it] INFO: Saving data for 1984730: {'auction_closing_time': 1774859400.0, 'created_time': 1774542721.63548, 'last_price_update_time': 1774629456.960549}
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984730') HTTP/1.1" 204 0
2026-03-27 16:37:36 [ayvens.it] INFO: Found listing with ID: 1984731
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984731%27 HTTP/1.1" 200 None
2026-03-27 16:37:36 [ayvens.it] INFO: Scrape type for 1984731: 2
2026-03-27 16:37:36 [ayvens.it] INFO: Extracting data for car ID: 1984731
2026-03-27 16:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37f6b88-4fc9-5bc9-bcb7-0d5eb10d1a34 with identifier: 1984731
2026-03-27 16:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37f6b88-4fc9-5bc9-bcb7-0d5eb10d1a34 with scrape type 2
2026-03-27 16:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d37f6b88-4fc9-5bc9-bcb7-0d5eb10d1a34 with scrape type 2
2026-03-27 16:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d37f6b88-4fc9-5bc9-bcb7-0d5eb10d1a34, identifier: 1984731
2026-03-27 16:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d37f6b88-4fc9-5bc9-bcb7-0d5eb10d1a34 with identifier: 1984731
2026-03-27 16:37:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d37f6b88-4fc9-5bc9-bcb7-0d5eb10d1a34 with identifier: 1984731
2026-03-27 16:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d37f6b88-4fc9-5bc9-bcb7-0d5eb10d1a34 with identifier: 1984731 to the API
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'EIGER GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'd37f6b88-4fc9-5bc9-bcb7-0d5eb10d1a34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 MHEV R-Dynamic S AWD auto '
'Sport utility vehicle 5-door (Euro 6D)',
'odometer': 44875,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVOQUE 2.0 D163 MHEV R-Dynamic S '
'AWD auto Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984731%27 HTTP/1.1" 200 None
2026-03-27 16:37:37 [ayvens.it] INFO: Saving data for 1984731: {'auction_closing_time': 1774859400.0, 'created_time': 1774542723.593967, 'last_price_update_time': 1774629457.334802}
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984731') HTTP/1.1" 204 0
2026-03-27 16:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c54890>
2026-03-27 16:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Feb746cae1db248e09eff5681afe1847c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/2.jpg saved to cache
2026-03-27 16:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1
2026-03-27 16:37:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1, skipping ID generation
2026-03-27 16:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1 with scrape type 1
2026-03-27 16:37:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1 sending to next pipeline
2026-03-27 16:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1, identifier: 1988975
2026-03-27 16:37:37 [ayvens.it] INFO: Found listing with ID: 1984732
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984732%27 HTTP/1.1" 200 None
2026-03-27 16:37:37 [ayvens.it] INFO: Scrape type for 1984732: 2
2026-03-27 16:37:37 [ayvens.it] INFO: Extracting data for car ID: 1984732
2026-03-27 16:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b5d183-30fb-54f2-8e56-0dbcf23c160c with identifier: 1984732
2026-03-27 16:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b5d183-30fb-54f2-8e56-0dbcf23c160c with scrape type 2
2026-03-27 16:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62b5d183-30fb-54f2-8e56-0dbcf23c160c with scrape type 2
2026-03-27 16:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 62b5d183-30fb-54f2-8e56-0dbcf23c160c, identifier: 1984732
2026-03-27 16:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1 with identifier: 1988975
2026-03-27 16:37:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1 with identifier: 1988975
2026-03-27 16:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1 with identifier: 1988975 to the API
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT 290 L2H2 Trend 2.0 Eco MHEV 130 Cv Furgone 4-door '
'(Euro 6.2)',
'odometer': 67528,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 63,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700016,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628957,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 721408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611921,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 714459,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1/94d2f25e-823f-5eb1-bfae-4afbdd1cd4f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/eb746cae1db248e09eff5681afe1847c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT 290 L2H2 Trend 2.0 Eco MHEV 130 Cv Furgone 4-door '
'(Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988975%27 HTTP/1.1" 200 None
2026-03-27 16:37:37 [ayvens.it] INFO: Saving data for 1988975: {'created_time': 1774629457.990529, 'last_price_update_time': 1774629457.99054, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988975') HTTP/1.1" 204 0
2026-03-27 16:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 62b5d183-30fb-54f2-8e56-0dbcf23c160c with identifier: 1984732
2026-03-27 16:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 62b5d183-30fb-54f2-8e56-0dbcf23c160c with identifier: 1984732
2026-03-27 16:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 62b5d183-30fb-54f2-8e56-0dbcf23c160c with identifier: 1984732 to the API
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '62b5d183-30fb-54f2-8e56-0dbcf23c160c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN PASSAT SW (PC) VAR. 2.0 TDI SCR EVO 110KW EXECUTIVE DSG '
'F FP',
'odometer': 159580,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN PASSAT SW (PC) VAR. 2.0 TDI SCR EVO 110KW '
'EXECUTIVE DSG F FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984732%27 HTTP/1.1" 200 None
2026-03-27 16:37:38 [ayvens.it] INFO: Saving data for 1984732: {'auction_closing_time': 1774859400.0, 'created_time': 1774542724.878402, 'last_price_update_time': 1774629458.373666}
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984732') HTTP/1.1" 204 0
2026-03-27 16:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:38 [ayvens.it] INFO: Found listing with ID: 1984733
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984733%27 HTTP/1.1" 200 None
2026-03-27 16:37:38 [ayvens.it] INFO: Scrape type for 1984733: 2
2026-03-27 16:37:38 [ayvens.it] INFO: Extracting data for car ID: 1984733
2026-03-27 16:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1580671d-3a9e-53ce-93c0-537f97def608 with identifier: 1984733
2026-03-27 16:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1580671d-3a9e-53ce-93c0-537f97def608 with scrape type 2
2026-03-27 16:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1580671d-3a9e-53ce-93c0-537f97def608 with scrape type 2
2026-03-27 16:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1580671d-3a9e-53ce-93c0-537f97def608, identifier: 1984733
2026-03-27 16:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1580671d-3a9e-53ce-93c0-537f97def608 with identifier: 1984733
2026-03-27 16:37:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1580671d-3a9e-53ce-93c0-537f97def608 with identifier: 1984733
2026-03-27 16:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1580671d-3a9e-53ce-93c0-537f97def608 with identifier: 1984733 to the API
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO GRAPHITE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '1580671d-3a9e-53ce-93c0-537f97def608',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA WAGON 2.0 TDI EVO 85KW EXECUTIVE DSG SW 5-door (Euro '
'6D)',
'odometer': 34289,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA WAGON 2.0 TDI EVO 85KW EXECUTIVE DSG SW 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984733%27 HTTP/1.1" 200 None
2026-03-27 16:37:38 [ayvens.it] INFO: Saving data for 1984733: {'auction_closing_time': 1774859400.0, 'created_time': 1774542726.317118, 'last_price_update_time': 1774629458.96229}
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984733') HTTP/1.1" 204 0
2026-03-27 16:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ace190>
2026-03-27 16:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj2%252F9c2ec5414bad4525a5f77a98746ad7a6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/2.jpg saved to cache
2026-03-27 16:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53a540c7-8622-5a45-a942-469ec9a5bcef
2026-03-27 16:37:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53a540c7-8622-5a45-a942-469ec9a5bcef, skipping ID generation
2026-03-27 16:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a540c7-8622-5a45-a942-469ec9a5bcef with scrape type 1
2026-03-27 16:37:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53a540c7-8622-5a45-a942-469ec9a5bcef sending to next pipeline
2026-03-27 16:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 53a540c7-8622-5a45-a942-469ec9a5bcef, identifier: 1988974
2026-03-27 16:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68540190>
2026-03-27 16:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/4.jpg saved to cache
2026-03-27 16:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:39 [ayvens.it] INFO: Found listing with ID: 1984734
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984734%27 HTTP/1.1" 200 None
2026-03-27 16:37:39 [ayvens.it] INFO: Scrape type for 1984734: 2
2026-03-27 16:37:39 [ayvens.it] INFO: Extracting data for car ID: 1984734
2026-03-27 16:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2db71b7b-322a-53f2-a3f6-e221047d38d3 with identifier: 1984734
2026-03-27 16:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2db71b7b-322a-53f2-a3f6-e221047d38d3 with scrape type 2
2026-03-27 16:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2db71b7b-322a-53f2-a3f6-e221047d38d3 with scrape type 2
2026-03-27 16:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2db71b7b-322a-53f2-a3f6-e221047d38d3, identifier: 1984734
2026-03-27 16:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 53a540c7-8622-5a45-a942-469ec9a5bcef with identifier: 1988974
2026-03-27 16:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 53a540c7-8622-5a45-a942-469ec9a5bcef with identifier: 1988974
2026-03-27 16:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 53a540c7-8622-5a45-a942-469ec9a5bcef with identifier: 1988974 to the API
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Mineral Grey metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '53a540c7-8622-5a45-a942-469ec9a5bcef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 sDrive 18d Business Advantage Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 144190,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 786642,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 786642,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 823797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 807845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 736504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 743182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a540c7-8622-5a45-a942-469ec9a5bcef/53a540c7-8622-5a45-a942-469ec9a5bcef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj2/9c2ec5414bad4525a5f77a98746ad7a6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 sDrive 18d Business Advantage Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988974%27 HTTP/1.1" 200 None
2026-03-27 16:37:39 [ayvens.it] INFO: Saving data for 1988974: {'created_time': 1774629459.673212, 'last_price_update_time': 1774629459.673225, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988974') HTTP/1.1" 204 0
2026-03-27 16:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2db71b7b-322a-53f2-a3f6-e221047d38d3 with identifier: 1984734
2026-03-27 16:37:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2db71b7b-322a-53f2-a3f6-e221047d38d3 with identifier: 1984734
2026-03-27 16:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2db71b7b-322a-53f2-a3f6-e221047d38d3 with identifier: 1984734 to the API
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Chrome Blue metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '2db71b7b-322a-53f2-a3f6-e221047d38d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 102318,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984734%27 HTTP/1.1" 200 None
2026-03-27 16:37:40 [ayvens.it] INFO: Saving data for 1984734: {'auction_closing_time': 1774859400.0, 'created_time': 1774542729.044685, 'last_price_update_time': 1774629460.026444}
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984734') HTTP/1.1" 204 0
2026-03-27 16:37:40 [ayvens.it] INFO: Found listing with ID: 1984735
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984735%27 HTTP/1.1" 200 None
2026-03-27 16:37:40 [ayvens.it] INFO: Scrape type for 1984735: 2
2026-03-27 16:37:40 [ayvens.it] INFO: Extracting data for car ID: 1984735
2026-03-27 16:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52b9f88d-3139-557f-9ad5-ee6410bcbba5 with identifier: 1984735
2026-03-27 16:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52b9f88d-3139-557f-9ad5-ee6410bcbba5 with scrape type 2
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52b9f88d-3139-557f-9ad5-ee6410bcbba5 with scrape type 2
2026-03-27 16:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 52b9f88d-3139-557f-9ad5-ee6410bcbba5, identifier: 1984735
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690f0690>
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/6.jpg saved to cache
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69141450>
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj4%252Fd226fe0de5684bbdbe3c1f5ad78ae486%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/3.jpg saved to cache
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4af916d5-4b18-50e3-a3b9-665f86c8faff
2026-03-27 16:37:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4af916d5-4b18-50e3-a3b9-665f86c8faff, skipping ID generation
2026-03-27 16:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af916d5-4b18-50e3-a3b9-665f86c8faff with scrape type 1
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4af916d5-4b18-50e3-a3b9-665f86c8faff sending to next pipeline
2026-03-27 16:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4af916d5-4b18-50e3-a3b9-665f86c8faff, identifier: 1988973
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684f92d0>
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj7%252Feb7fbfffc0c44004a25ccab62c7fd7b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/3.jpg saved to cache
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58f27fd0-15f9-5ae6-94de-a911785b0086
2026-03-27 16:37:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58f27fd0-15f9-5ae6-94de-a911785b0086, skipping ID generation
2026-03-27 16:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f27fd0-15f9-5ae6-94de-a911785b0086 with scrape type 1
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58f27fd0-15f9-5ae6-94de-a911785b0086 sending to next pipeline
2026-03-27 16:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 58f27fd0-15f9-5ae6-94de-a911785b0086, identifier: 1988972
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69143d10>
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj6%252F79e6da16461e4906807cd5beea877ec5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/7.jpg saved to cache
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a390e93-1fea-556d-b158-a059dae8ba68
2026-03-27 16:37:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a390e93-1fea-556d-b158-a059dae8ba68, skipping ID generation
2026-03-27 16:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a390e93-1fea-556d-b158-a059dae8ba68 with scrape type 1
2026-03-27 16:37:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a390e93-1fea-556d-b158-a059dae8ba68 sending to next pipeline
2026-03-27 16:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5a390e93-1fea-556d-b158-a059dae8ba68, identifier: 1988971
2026-03-27 16:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 52b9f88d-3139-557f-9ad5-ee6410bcbba5 with identifier: 1984735
2026-03-27 16:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 52b9f88d-3139-557f-9ad5-ee6410bcbba5 with identifier: 1984735
2026-03-27 16:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 52b9f88d-3139-557f-9ad5-ee6410bcbba5 with identifier: 1984735 to the API
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO RIFLESSO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '52b9f88d-3139-557f-9ad5-ee6410bcbba5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP',
'odometer': 176485,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984735%27 HTTP/1.1" 200 None
2026-03-27 16:37:41 [ayvens.it] INFO: Saving data for 1984735: {'auction_closing_time': 1774859400.0, 'created_time': 1774542731.15941, 'last_price_update_time': 1774629461.033272}
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984735') HTTP/1.1" 204 0
2026-03-27 16:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4af916d5-4b18-50e3-a3b9-665f86c8faff with identifier: 1988973
2026-03-27 16:37:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4af916d5-4b18-50e3-a3b9-665f86c8faff with identifier: 1988973
2026-03-27 16:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4af916d5-4b18-50e3-a3b9-665f86c8faff with identifier: 1988973 to the API
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU ATOLLO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '4af916d5-4b18-50e3-a3b9-665f86c8faff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 35 TFSI S TRONIC BUSINESS ADV. S.BACK FP',
'odometer': 110928,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 871891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 915583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 871891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 858691,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 893889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577455,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 685171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af916d5-4b18-50e3-a3b9-665f86c8faff/4af916d5-4b18-50e3-a3b9-665f86c8faff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj4/d226fe0de5684bbdbe3c1f5ad78ae486/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 35 TFSI S TRONIC BUSINESS ADV. S.BACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988973%27 HTTP/1.1" 200 None
2026-03-27 16:37:41 [ayvens.it] INFO: Saving data for 1988973: {'created_time': 1774629461.396135, 'last_price_update_time': 1774629461.396148, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988973') HTTP/1.1" 204 0
2026-03-27 16:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 58f27fd0-15f9-5ae6-94de-a911785b0086 with identifier: 1988972
2026-03-27 16:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 58f27fd0-15f9-5ae6-94de-a911785b0086 with identifier: 1988972
2026-03-27 16:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 58f27fd0-15f9-5ae6-94de-a911785b0086 with identifier: 1988972 to the API
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DARK METAL GREY METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '58f27fd0-15f9-5ae6-94de-a911785b0086',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI 1.3 MHEV 140 Business Cross over 5-door (Euro 6D)',
'odometer': 92808,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672875,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683104,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f27fd0-15f9-5ae6-94de-a911785b0086/58f27fd0-15f9-5ae6-94de-a911785b0086_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516642,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj7/eb7fbfffc0c44004a25ccab62c7fd7b9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI 1.3 MHEV 140 Business Cross over 5-door (Euro '
'6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988972%27 HTTP/1.1" 200 None
2026-03-27 16:37:41 [ayvens.it] INFO: Saving data for 1988972: {'created_time': 1774629461.736917, 'last_price_update_time': 1774629461.736928, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988972') HTTP/1.1" 204 0
2026-03-27 16:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5a390e93-1fea-556d-b158-a059dae8ba68 with identifier: 1988971
2026-03-27 16:37:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5a390e93-1fea-556d-b158-a059dae8ba68 with identifier: 1988971
2026-03-27 16:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5a390e93-1fea-556d-b158-a059dae8ba68 with identifier: 1988971 to the API
2026-03-27 16:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'LONDON GREY MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '5a390e93-1fea-556d-b158-a059dae8ba68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW (PC) TS HYBRID BUSINESS FP',
'odometer': 142490,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 730751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701243,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738479,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587044,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a390e93-1fea-556d-b158-a059dae8ba68/5a390e93-1fea-556d-b158-a059dae8ba68_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502423,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj6/79e6da16461e4906807cd5beea877ec5/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW (PC) TS HYBRID BUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988971%27 HTTP/1.1" 200 None
2026-03-27 16:37:42 [ayvens.it] INFO: Saving data for 1988971: {'created_time': 1774629462.140555, 'last_price_update_time': 1774629462.140565, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988971') HTTP/1.1" 204 0
2026-03-27 16:37:42 [ayvens.it] INFO: Found listing with ID: 1984736
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984736%27 HTTP/1.1" 200 None
2026-03-27 16:37:42 [ayvens.it] INFO: Scrape type for 1984736: 2
2026-03-27 16:37:42 [ayvens.it] INFO: Extracting data for car ID: 1984736
2026-03-27 16:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b49a62d8-efcd-5d09-b268-93f0f75f472a with identifier: 1984736
2026-03-27 16:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b49a62d8-efcd-5d09-b268-93f0f75f472a with scrape type 2
2026-03-27 16:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b49a62d8-efcd-5d09-b268-93f0f75f472a with scrape type 2
2026-03-27 16:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b49a62d8-efcd-5d09-b268-93f0f75f472a, identifier: 1984736
2026-03-27 16:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ef5050>
2026-03-27 16:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/8.jpg saved to cache
2026-03-27 16:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f99250>
2026-03-27 16:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/7.jpg saved to cache
2026-03-27 16:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b49a62d8-efcd-5d09-b268-93f0f75f472a with identifier: 1984736
2026-03-27 16:37:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b49a62d8-efcd-5d09-b268-93f0f75f472a with identifier: 1984736
2026-03-27 16:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b49a62d8-efcd-5d09-b268-93f0f75f472a with identifier: 1984736 to the API
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'KAOLIN WHITE',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'b49a62d8-efcd-5d09-b268-93f0f75f472a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT BOXER 435 L3 2.2 BLUEHDI 140+FURG.+SPONDA FP',
'odometer': 22683,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-10-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT BOXER 435 L3 2.2 BLUEHDI 140+FURG.+SPONDA FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984736%27 HTTP/1.1" 200 None
2026-03-27 16:37:42 [ayvens.it] INFO: Saving data for 1984736: {'auction_closing_time': 1774859400.0, 'created_time': 1774542732.573751, 'last_price_update_time': 1774629462.897261}
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984736') HTTP/1.1" 204 0
2026-03-27 16:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:42 [ayvens.it] INFO: Found listing with ID: 1984737
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984737%27 HTTP/1.1" 200 None
2026-03-27 16:37:42 [ayvens.it] INFO: Scrape type for 1984737: 2
2026-03-27 16:37:42 [ayvens.it] INFO: Extracting data for car ID: 1984737
2026-03-27 16:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69a14efe-098a-51c0-97ed-ced4c8b3c668 with identifier: 1984737
2026-03-27 16:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69a14efe-098a-51c0-97ed-ced4c8b3c668 with scrape type 2
2026-03-27 16:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69a14efe-098a-51c0-97ed-ced4c8b3c668 with scrape type 2
2026-03-27 16:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 69a14efe-098a-51c0-97ed-ced4c8b3c668, identifier: 1984737
2026-03-27 16:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 69a14efe-098a-51c0-97ed-ced4c8b3c668 with identifier: 1984737
2026-03-27 16:37:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 69a14efe-098a-51c0-97ed-ced4c8b3c668 with identifier: 1984737
2026-03-27 16:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 69a14efe-098a-51c0-97ed-ced4c8b3c668 with identifier: 1984737 to the API
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '69a14efe-098a-51c0-97ed-ced4c8b3c668',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 T6 Plug-in AWD auto Core Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 144152,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 T6 Plug-in AWD auto Core Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984737%27 HTTP/1.1" 200 None
2026-03-27 16:37:43 [ayvens.it] INFO: Saving data for 1984737: {'auction_closing_time': 1774859400.0, 'created_time': 1774542734.065961, 'last_price_update_time': 1774629463.2657}
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984737') HTTP/1.1" 204 0
2026-03-27 16:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:43 [ayvens.it] INFO: Found listing with ID: 1984738
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984738%27 HTTP/1.1" 200 None
2026-03-27 16:37:43 [ayvens.it] INFO: Scrape type for 1984738: 2
2026-03-27 16:37:43 [ayvens.it] INFO: Extracting data for car ID: 1984738
2026-03-27 16:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ff372df-1f2d-5bd4-8835-dfd3bb47b3f5 with identifier: 1984738
2026-03-27 16:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ff372df-1f2d-5bd4-8835-dfd3bb47b3f5 with scrape type 2
2026-03-27 16:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ff372df-1f2d-5bd4-8835-dfd3bb47b3f5 with scrape type 2
2026-03-27 16:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0ff372df-1f2d-5bd4-8835-dfd3bb47b3f5, identifier: 1984738
2026-03-27 16:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0ff372df-1f2d-5bd4-8835-dfd3bb47b3f5 with identifier: 1984738
2026-03-27 16:37:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0ff372df-1f2d-5bd4-8835-dfd3bb47b3f5 with identifier: 1984738
2026-03-27 16:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0ff372df-1f2d-5bd4-8835-dfd3bb47b3f5 with identifier: 1984738 to the API
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK SAPPHIRE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '0ff372df-1f2d-5bd4-8835-dfd3bb47b3f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X5 xDrive 30d MH48V Msport autom. Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 81265,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X5 xDrive 30d MH48V Msport autom. Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984738%27 HTTP/1.1" 200 None
2026-03-27 16:37:43 [ayvens.it] INFO: Saving data for 1984738: {'auction_closing_time': 1774859400.0, 'created_time': 1774542736.158198, 'last_price_update_time': 1774629463.627519}
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984738') HTTP/1.1" 204 0
2026-03-27 16:37:43 [ayvens.it] INFO: Found listing with ID: 1984739
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984739%27 HTTP/1.1" 200 None
2026-03-27 16:37:43 [ayvens.it] INFO: Scrape type for 1984739: 2
2026-03-27 16:37:43 [ayvens.it] INFO: Extracting data for car ID: 1984739
2026-03-27 16:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b62cb8f-96e4-5f46-91f3-f50c5a00fcc9 with identifier: 1984739
2026-03-27 16:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b62cb8f-96e4-5f46-91f3-f50c5a00fcc9 with scrape type 2
2026-03-27 16:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b62cb8f-96e4-5f46-91f3-f50c5a00fcc9 with scrape type 2
2026-03-27 16:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3b62cb8f-96e4-5f46-91f3-f50c5a00fcc9, identifier: 1984739
2026-03-27 16:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3b62cb8f-96e4-5f46-91f3-f50c5a00fcc9 with identifier: 1984739
2026-03-27 16:37:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3b62cb8f-96e4-5f46-91f3-f50c5a00fcc9 with identifier: 1984739
2026-03-27 16:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3b62cb8f-96e4-5f46-91f3-f50c5a00fcc9 with identifier: 1984739 to the API
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'JADE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '3b62cb8f-96e4-5f46-91f3-f50c5a00fcc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL VIVARO 1.5 DIESEL 100CV S&S L3H1 ENJOY P.M. FP',
'odometer': 113319,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL VIVARO 1.5 DIESEL 100CV S&S L3H1 ENJOY P.M. FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984739%27 HTTP/1.1" 200 None
2026-03-27 16:37:44 [ayvens.it] INFO: Saving data for 1984739: {'auction_closing_time': 1774859400.0, 'created_time': 1774542737.628752, 'last_price_update_time': 1774629464.084161}
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984739') HTTP/1.1" 204 0
2026-03-27 16:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c7b510>
2026-03-27 16:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252Ffec84837b103466fa8209c8f1fa3d704%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/6.jpg saved to cache
2026-03-27 16:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa633a22-c8dc-55ec-a76c-aacecfc041b3
2026-03-27 16:37:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa633a22-c8dc-55ec-a76c-aacecfc041b3, skipping ID generation
2026-03-27 16:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa633a22-c8dc-55ec-a76c-aacecfc041b3 with scrape type 1
2026-03-27 16:37:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa633a22-c8dc-55ec-a76c-aacecfc041b3 sending to next pipeline
2026-03-27 16:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fa633a22-c8dc-55ec-a76c-aacecfc041b3, identifier: 1988969
2026-03-27 16:37:44 [ayvens.it] INFO: Found listing with ID: 1984740
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984740%27 HTTP/1.1" 200 None
2026-03-27 16:37:44 [ayvens.it] INFO: Scrape type for 1984740: 2
2026-03-27 16:37:44 [ayvens.it] INFO: Extracting data for car ID: 1984740
2026-03-27 16:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c302b491-ed2e-5c3e-942f-ec852303e3f0 with identifier: 1984740
2026-03-27 16:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c302b491-ed2e-5c3e-942f-ec852303e3f0 with scrape type 2
2026-03-27 16:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c302b491-ed2e-5c3e-942f-ec852303e3f0 with scrape type 2
2026-03-27 16:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c302b491-ed2e-5c3e-942f-ec852303e3f0, identifier: 1984740
2026-03-27 16:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fa633a22-c8dc-55ec-a76c-aacecfc041b3 with identifier: 1988969
2026-03-27 16:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fa633a22-c8dc-55ec-a76c-aacecfc041b3 with identifier: 1988969
2026-03-27 16:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fa633a22-c8dc-55ec-a76c-aacecfc041b3 with identifier: 1988969 to the API
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco pastello',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'fa633a22-c8dc-55ec-a76c-aacecfc041b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO CH1 BUSINESS 1.6 Mjet 105cv E6D-f S&S Vettura '
'Furgonata 4-door (Euro 6D)',
'odometer': 153834,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633311,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609259,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583174,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648349,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513210,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa633a22-c8dc-55ec-a76c-aacecfc041b3/fa633a22-c8dc-55ec-a76c-aacecfc041b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/fec84837b103466fa8209c8f1fa3d704/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO CH1 BUSINESS 1.6 Mjet 105cv E6D-f S&S Vettura '
'Furgonata 4-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988969%27 HTTP/1.1" 200 None
2026-03-27 16:37:44 [ayvens.it] INFO: Saving data for 1988969: {'created_time': 1774629464.919675, 'last_price_update_time': 1774629464.91969, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988969') HTTP/1.1" 204 0
2026-03-27 16:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c302b491-ed2e-5c3e-942f-ec852303e3f0 with identifier: 1984740
2026-03-27 16:37:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c302b491-ed2e-5c3e-942f-ec852303e3f0 with identifier: 1984740
2026-03-27 16:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c302b491-ed2e-5c3e-942f-ec852303e3f0 with identifier: 1984740 to the API
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SILVER METALLIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'c302b491-ed2e-5c3e-942f-ec852303e3f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA YARIS 1.5 Hybrid Active Hatchback 5-door',
'odometer': 107455,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA YARIS 1.5 Hybrid Active Hatchback 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984740%27 HTTP/1.1" 200 None
2026-03-27 16:37:45 [ayvens.it] INFO: Saving data for 1984740: {'auction_closing_time': 1774859400.0, 'created_time': 1774542739.252576, 'last_price_update_time': 1774629465.225221}
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984740') HTTP/1.1" 204 0
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69427f50>
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/8.jpg saved to cache
2026-03-27 16:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e690718d0>
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F3e73ec500a5a479da3c36fd42710eeeb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/6.jpg saved to cache
2026-03-27 16:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36747356-19a0-5d75-a491-806cf9043e91
2026-03-27 16:37:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36747356-19a0-5d75-a491-806cf9043e91, skipping ID generation
2026-03-27 16:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36747356-19a0-5d75-a491-806cf9043e91 with scrape type 1
2026-03-27 16:37:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36747356-19a0-5d75-a491-806cf9043e91 sending to next pipeline
2026-03-27 16:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 36747356-19a0-5d75-a491-806cf9043e91, identifier: 1988968
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5eb50>
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/8.jpg saved to cache
2026-03-27 16:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:37:45 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-27 16:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 36747356-19a0-5d75-a491-806cf9043e91 with identifier: 1988968
2026-03-27 16:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 36747356-19a0-5d75-a491-806cf9043e91 with identifier: 1988968
2026-03-27 16:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 36747356-19a0-5d75-a491-806cf9043e91 with identifier: 1988968 to the API
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '36747356-19a0-5d75-a491-806cf9043e91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO MAXI LH1 BUSINESS 1.6 Mjet 105cv E6D S&S Vettura '
'Furgonata 4-door (Euro 6D)',
'odometer': 145404,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749065,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749065,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629655,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606399,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36747356-19a0-5d75-a491-806cf9043e91/36747356-19a0-5d75-a491-806cf9043e91_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/3e73ec500a5a479da3c36fd42710eeeb/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO MAXI LH1 BUSINESS 1.6 Mjet 105cv E6D S&S '
'Vettura Furgonata 4-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988968%27 HTTP/1.1" 200 None
2026-03-27 16:37:45 [ayvens.it] INFO: Saving data for 1988968: {'created_time': 1774629465.920316, 'last_price_update_time': 1774629465.920328, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988968') HTTP/1.1" 204 0
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68feee50>
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252Fb93b04458a224cf6bd6fc7833d5e8126%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/6.jpg saved to cache
2026-03-27 16:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb
2026-03-27 16:37:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a26fcbb3-eedb-5dad-919c-4fd9f89483bb, skipping ID generation
2026-03-27 16:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb with scrape type 1
2026-03-27 16:37:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a26fcbb3-eedb-5dad-919c-4fd9f89483bb sending to next pipeline
2026-03-27 16:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a26fcbb3-eedb-5dad-919c-4fd9f89483bb, identifier: 1988966
2026-03-27 16:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684fb590>
2026-03-27 16:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F17d3f1f9b44940e9aaf1cdde853bef8f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/5.jpg saved to cache
2026-03-27 16:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da74ea51-0176-5a2f-856a-f1e8d069b2c3
2026-03-27 16:37:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da74ea51-0176-5a2f-856a-f1e8d069b2c3, skipping ID generation
2026-03-27 16:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da74ea51-0176-5a2f-856a-f1e8d069b2c3 with scrape type 1
2026-03-27 16:37:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da74ea51-0176-5a2f-856a-f1e8d069b2c3 sending to next pipeline
2026-03-27 16:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: da74ea51-0176-5a2f-856a-f1e8d069b2c3, identifier: 1988967
2026-03-27 16:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c4a3d0>
2026-03-27 16:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F4fd078651d8b4c86bfb71bc48a9ab915%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/7.jpg saved to cache
2026-03-27 16:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c42a761d-f342-5525-82fc-f02240b53738
2026-03-27 16:37:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c42a761d-f342-5525-82fc-f02240b53738, skipping ID generation
2026-03-27 16:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42a761d-f342-5525-82fc-f02240b53738 with scrape type 1
2026-03-27 16:37:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c42a761d-f342-5525-82fc-f02240b53738 sending to next pipeline
2026-03-27 16:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c42a761d-f342-5525-82fc-f02240b53738, identifier: 1988965
2026-03-27 16:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a26fcbb3-eedb-5dad-919c-4fd9f89483bb with identifier: 1988966
2026-03-27 16:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a26fcbb3-eedb-5dad-919c-4fd9f89483bb with identifier: 1988966
2026-03-27 16:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a26fcbb3-eedb-5dad-919c-4fd9f89483bb with identifier: 1988966 to the API
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero Tulipano perlato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'a26fcbb3-eedb-5dad-919c-4fd9f89483bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KODIAQ 2.0 TDI EVO SCR EXECUTIVE DSG 5p Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 130944,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559682,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634716,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26fcbb3-eedb-5dad-919c-4fd9f89483bb/a26fcbb3-eedb-5dad-919c-4fd9f89483bb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/b93b04458a224cf6bd6fc7833d5e8126/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KODIAQ 2.0 TDI EVO SCR EXECUTIVE DSG 5p Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988966%27 HTTP/1.1" 200 None
2026-03-27 16:37:46 [ayvens.it] INFO: Saving data for 1988966: {'created_time': 1774629466.764008, 'last_price_update_time': 1774629466.764018, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988966') HTTP/1.1" 204 0
2026-03-27 16:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: da74ea51-0176-5a2f-856a-f1e8d069b2c3 with identifier: 1988967
2026-03-27 16:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: da74ea51-0176-5a2f-856a-f1e8d069b2c3 with identifier: 1988967
2026-03-27 16:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: da74ea51-0176-5a2f-856a-f1e8d069b2c3 with identifier: 1988967 to the API
2026-03-27 16:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ARTICO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'da74ea51-0176-5a2f-856a-f1e8d069b2c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES SPRINTER 314 CDI F39/33 T.ALTO P.M. TR.ANT. FP',
'odometer': 92723,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 71,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da74ea51-0176-5a2f-856a-f1e8d069b2c3/da74ea51-0176-5a2f-856a-f1e8d069b2c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/17d3f1f9b44940e9aaf1cdde853bef8f/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES SPRINTER 314 CDI F39/33 T.ALTO P.M. TR.ANT. '
'FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988967%27 HTTP/1.1" 200 None
2026-03-27 16:37:47 [ayvens.it] INFO: Saving data for 1988967: {'created_time': 1774629467.274567, 'last_price_update_time': 1774629467.274578, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988967') HTTP/1.1" 204 0
2026-03-27 16:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c42a761d-f342-5525-82fc-f02240b53738 with identifier: 1988965
2026-03-27 16:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c42a761d-f342-5525-82fc-f02240b53738 with identifier: 1988965
2026-03-27 16:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c42a761d-f342-5525-82fc-f02240b53738 with identifier: 1988965 to the API
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO BANQUISE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'c42a761d-f342-5525-82fc-f02240b53738',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN',
'odometer': 107954,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 837665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 789023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527225,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674542,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c42a761d-f342-5525-82fc-f02240b53738/c42a761d-f342-5525-82fc-f02240b53738_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/4fd078651d8b4c86bfb71bc48a9ab915/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL VAN -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988965%27 HTTP/1.1" 200 None
2026-03-27 16:37:47 [ayvens.it] INFO: Saving data for 1988965: {'created_time': 1774629467.62226, 'last_price_update_time': 1774629467.62227, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988965') HTTP/1.1" 204 0
2026-03-27 16:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b19190>
2026-03-27 16:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252Fd47d5f1393444ee598821c56902fa4a8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/7.jpg saved to cache
2026-03-27 16:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d46e9d87-218d-517b-b7f3-56f47d1410fe
2026-03-27 16:37:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d46e9d87-218d-517b-b7f3-56f47d1410fe, skipping ID generation
2026-03-27 16:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46e9d87-218d-517b-b7f3-56f47d1410fe with scrape type 1
2026-03-27 16:37:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d46e9d87-218d-517b-b7f3-56f47d1410fe sending to next pipeline
2026-03-27 16:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d46e9d87-218d-517b-b7f3-56f47d1410fe, identifier: 1988964
2026-03-27 16:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d46e9d87-218d-517b-b7f3-56f47d1410fe with identifier: 1988964
2026-03-27 16:37:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d46e9d87-218d-517b-b7f3-56f47d1410fe with identifier: 1988964
2026-03-27 16:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d46e9d87-218d-517b-b7f3-56f47d1410fe with identifier: 1988964 to the API
2026-03-27 16:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CARBON BLACK',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'd46e9d87-218d-517b-b7f3-56f47d1410fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP COMPASS (PC) 1.3 T4 PHEV 190CV BUSINESS 4XE AUTO FP',
'odometer': 124405,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 844309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 844309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 848310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 832010,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664464,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e9d87-218d-517b-b7f3-56f47d1410fe/d46e9d87-218d-517b-b7f3-56f47d1410fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/d47d5f1393444ee598821c56902fa4a8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP COMPASS (PC) 1.3 T4 PHEV 190CV BUSINESS 4XE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988964%27 HTTP/1.1" 200 None
2026-03-27 16:37:48 [ayvens.it] INFO: Saving data for 1988964: {'created_time': 1774629468.143281, 'last_price_update_time': 1774629468.14329, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988964') HTTP/1.1" 204 0
2026-03-27 16:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1cd50>
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/9.jpg saved to cache
2026-03-27 16:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68521a90>
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/8.jpg saved to cache
2026-03-27 16:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b66110>
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh0%252Fedd64aa4220d45eba8d401c1e03b6b36%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/7.jpg saved to cache
2026-03-27 16:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9a3271e-25b7-5f7a-aff8-28aa46299a87
2026-03-27 16:37:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9a3271e-25b7-5f7a-aff8-28aa46299a87, skipping ID generation
2026-03-27 16:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a3271e-25b7-5f7a-aff8-28aa46299a87 with scrape type 1
2026-03-27 16:37:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9a3271e-25b7-5f7a-aff8-28aa46299a87 sending to next pipeline
2026-03-27 16:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d9a3271e-25b7-5f7a-aff8-28aa46299a87, identifier: 1988963
2026-03-27 16:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d9a3271e-25b7-5f7a-aff8-28aa46299a87 with identifier: 1988963
2026-03-27 16:37:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d9a3271e-25b7-5f7a-aff8-28aa46299a87 with identifier: 1988963
2026-03-27 16:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d9a3271e-25b7-5f7a-aff8-28aa46299a87 with identifier: 1988963 to the API
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GESSO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.9L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'd9a3271e-25b7-5f7a-aff8-28aa46299a87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PORSCHE',
'model': 'PORSCHE PANAMERA PANAMERA 4S E-HYBRID SPORT TURISMO FP',
'odometer': 79521,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479349,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468015,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367065,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485178,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a3271e-25b7-5f7a-aff8-28aa46299a87/d9a3271e-25b7-5f7a-aff8-28aa46299a87_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh0/edd64aa4220d45eba8d401c1e03b6b36/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'PORSCHE PORSCHE PANAMERA PANAMERA 4S E-HYBRID SPORT TURISMO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988963%27 HTTP/1.1" 200 None
2026-03-27 16:37:48 [ayvens.it] INFO: Saving data for 1988963: {'created_time': 1774629468.770753, 'last_price_update_time': 1774629468.770766, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988963') HTTP/1.1" 204 0
2026-03-27 16:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c987d0>
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/9.jpg saved to cache
2026-03-27 16:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fad410>
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm4%252F4072dc1fb2394338b6fe91aa9edf8797%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/8.jpg saved to cache
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41e4dd95-6716-53c2-aedf-859273b2edb6
2026-03-27 16:37:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41e4dd95-6716-53c2-aedf-859273b2edb6, skipping ID generation
2026-03-27 16:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e4dd95-6716-53c2-aedf-859273b2edb6 with scrape type 1
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41e4dd95-6716-53c2-aedf-859273b2edb6 sending to next pipeline
2026-03-27 16:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 41e4dd95-6716-53c2-aedf-859273b2edb6, identifier: 1988953
2026-03-27 16:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 41e4dd95-6716-53c2-aedf-859273b2edb6 with identifier: 1988953
2026-03-27 16:37:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 41e4dd95-6716-53c2-aedf-859273b2edb6 with identifier: 1988953
2026-03-27 16:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 41e4dd95-6716-53c2-aedf-859273b2edb6 with identifier: 1988953 to the API
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'THUNDER GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '41e4dd95-6716-53c2-aedf-859273b2edb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO CORE FP',
'odometer': 87645,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720662,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556256,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422479,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e4dd95-6716-53c2-aedf-859273b2edb6/41e4dd95-6716-53c2-aedf-859273b2edb6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm4/4072dc1fb2394338b6fe91aa9edf8797/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO CORE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988953%27 HTTP/1.1" 200 None
2026-03-27 16:37:49 [ayvens.it] INFO: Saving data for 1988953: {'created_time': 1774629469.434456, 'last_price_update_time': 1774629469.43447, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988953') HTTP/1.1" 204 0
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c236d0>
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/2.jpg saved to cache
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c21f10>
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/7.jpg saved to cache
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68adedd0>
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj3%252F2909ce12d11d4982b9942b67b3dca7bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/1.jpg saved to cache
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84
2026-03-27 16:37:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bae7b0ab-d3f1-5faa-b791-6aebd7901c84, skipping ID generation
2026-03-27 16:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with scrape type 1
2026-03-27 16:37:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bae7b0ab-d3f1-5faa-b791-6aebd7901c84 sending to next pipeline
2026-03-27 16:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bae7b0ab-d3f1-5faa-b791-6aebd7901c84, identifier: 1988961
2026-03-27 16:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with identifier: 1988961
2026-03-27 16:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with identifier: 1988961
2026-03-27 16:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bae7b0ab-d3f1-5faa-b791-6aebd7901c84 with identifier: 1988961 to the API
2026-03-27 16:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO RIFLESSO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'bae7b0ab-d3f1-5faa-b791-6aebd7901c84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP',
'odometer': 226093,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae7b0ab-d3f1-5faa-b791-6aebd7901c84/bae7b0ab-d3f1-5faa-b791-6aebd7901c84_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548595,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj3/2909ce12d11d4982b9942b67b3dca7bb/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988961%27 HTTP/1.1" 200 None
2026-03-27 16:37:50 [ayvens.it] INFO: Saving data for 1988961: {'created_time': 1774629470.245911, 'last_price_update_time': 1774629470.24592, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988961') HTTP/1.1" 204 0
2026-03-27 16:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c20b10>
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252Fe8ed848eaa8a4084a677cb8baa38bba6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/6.jpg saved to cache
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82fe07fb-7e5b-595c-b720-1f7b8744488f
2026-03-27 16:37:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82fe07fb-7e5b-595c-b720-1f7b8744488f, skipping ID generation
2026-03-27 16:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82fe07fb-7e5b-595c-b720-1f7b8744488f with scrape type 1
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82fe07fb-7e5b-595c-b720-1f7b8744488f sending to next pipeline
2026-03-27 16:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 82fe07fb-7e5b-595c-b720-1f7b8744488f, identifier: 1988940
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6853e3d0>
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/7.jpg saved to cache
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68bee110>
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/8.jpg saved to cache
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1ea90>
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252Fad81a749c35647c1bade29dc622847cf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/7.jpg saved to cache
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6b7bffa-a3be-5a18-ae7f-94cac8849250
2026-03-27 16:37:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6b7bffa-a3be-5a18-ae7f-94cac8849250, skipping ID generation
2026-03-27 16:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b7bffa-a3be-5a18-ae7f-94cac8849250 with scrape type 1
2026-03-27 16:37:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6b7bffa-a3be-5a18-ae7f-94cac8849250 sending to next pipeline
2026-03-27 16:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f6b7bffa-a3be-5a18-ae7f-94cac8849250, identifier: 1988915
2026-03-27 16:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 82fe07fb-7e5b-595c-b720-1f7b8744488f with identifier: 1988940
2026-03-27 16:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 82fe07fb-7e5b-595c-b720-1f7b8744488f with identifier: 1988940
2026-03-27 16:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 82fe07fb-7e5b-595c-b720-1f7b8744488f with identifier: 1988940 to the API
2026-03-27 16:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '82fe07fb-7e5b-595c-b720-1f7b8744488f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP',
'odometer': 148100,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 82,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 834120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651020,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 658365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 708364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82fe07fb-7e5b-595c-b720-1f7b8744488f/82fe07fb-7e5b-595c-b720-1f7b8744488f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/e8ed848eaa8a4084a677cb8baa38bba6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S FEEL PACK FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988940%27 HTTP/1.1" 200 None
2026-03-27 16:37:51 [ayvens.it] INFO: Saving data for 1988940: {'created_time': 1774629471.363048, 'last_price_update_time': 1774629471.363059, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988940') HTTP/1.1" 204 0
2026-03-27 16:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f6b7bffa-a3be-5a18-ae7f-94cac8849250 with identifier: 1988915
2026-03-27 16:37:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f6b7bffa-a3be-5a18-ae7f-94cac8849250 with identifier: 1988915
2026-03-27 16:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f6b7bffa-a3be-5a18-ae7f-94cac8849250 with identifier: 1988915 to the API
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'f6b7bffa-a3be-5a18-ae7f-94cac8849250',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA RAV4 2.5 HV 218cv E-CVT Business 2WD Cross over 5-door (Euro '
'6.2)',
'odometer': 108608,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 47,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531187,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525389,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469719,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587779,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6b7bffa-a3be-5a18-ae7f-94cac8849250/f6b7bffa-a3be-5a18-ae7f-94cac8849250_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/ad81a749c35647c1bade29dc622847cf/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-05',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA RAV4 2.5 HV 218cv E-CVT Business 2WD Cross over '
'5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988915%27 HTTP/1.1" 200 None
2026-03-27 16:37:51 [ayvens.it] INFO: Saving data for 1988915: {'created_time': 1774629471.860531, 'last_price_update_time': 1774629471.86054, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988915') HTTP/1.1" 204 0
2026-03-27 16:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6900ac50>
2026-03-27 16:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd4%252F8a87d2bef4494fab947139932a7f1868%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/6.jpg saved to cache
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0b89a5c-db75-53c7-b7d2-95be3b735736
2026-03-27 16:37:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0b89a5c-db75-53c7-b7d2-95be3b735736, skipping ID generation
2026-03-27 16:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b89a5c-db75-53c7-b7d2-95be3b735736 with scrape type 1
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0b89a5c-db75-53c7-b7d2-95be3b735736 sending to next pipeline
2026-03-27 16:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b0b89a5c-db75-53c7-b7d2-95be3b735736, identifier: 1988916
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692350d0>
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes8%252F927915a197ee4742bfd246c9279032e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/10.jpg saved to cache
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aec951e5-0951-511c-9678-c638780da3e3
2026-03-27 16:37:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aec951e5-0951-511c-9678-c638780da3e3, skipping ID generation
2026-03-27 16:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec951e5-0951-511c-9678-c638780da3e3 with scrape type 1
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aec951e5-0951-511c-9678-c638780da3e3 sending to next pipeline
2026-03-27 16:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: aec951e5-0951-511c-9678-c638780da3e3, identifier: 1988912
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1e210>
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc0%252F70d357044cd84fe09330288944c92f32%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/8.jpg saved to cache
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ee61d1a-f235-5fd7-9a98-347822e652ca
2026-03-27 16:37:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ee61d1a-f235-5fd7-9a98-347822e652ca, skipping ID generation
2026-03-27 16:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee61d1a-f235-5fd7-9a98-347822e652ca with scrape type 1
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ee61d1a-f235-5fd7-9a98-347822e652ca sending to next pipeline
2026-03-27 16:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0ee61d1a-f235-5fd7-9a98-347822e652ca, identifier: 1988914
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e694f4510>
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm2%252F2174638c4b5d4795bd3597738a2a8f29%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/8.jpg saved to cache
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8114194-e648-5593-8945-aba28a51701c
2026-03-27 16:37:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8114194-e648-5593-8945-aba28a51701c, skipping ID generation
2026-03-27 16:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8114194-e648-5593-8945-aba28a51701c with scrape type 1
2026-03-27 16:37:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8114194-e648-5593-8945-aba28a51701c sending to next pipeline
2026-03-27 16:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a8114194-e648-5593-8945-aba28a51701c, identifier: 1988913
2026-03-27 16:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b0b89a5c-db75-53c7-b7d2-95be3b735736 with identifier: 1988916
2026-03-27 16:37:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b0b89a5c-db75-53c7-b7d2-95be3b735736 with identifier: 1988916
2026-03-27 16:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b0b89a5c-db75-53c7-b7d2-95be3b735736 with identifier: 1988916 to the API
2026-03-27 16:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GLACIER SILVER',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'b0b89a5c-db75-53c7-b7d2-95be3b735736',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X3 xDrive 20d MH48V Business Advantage Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 115547,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 812121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 799112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 812121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 785077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 786696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 685655,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564218,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 679108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b89a5c-db75-53c7-b7d2-95be3b735736/b0b89a5c-db75-53c7-b7d2-95be3b735736_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd4/8a87d2bef4494fab947139932a7f1868/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X3 xDrive 20d MH48V Business Advantage Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988916%27 HTTP/1.1" 200 None
2026-03-27 16:37:53 [ayvens.it] INFO: Saving data for 1988916: {'created_time': 1774629473.253275, 'last_price_update_time': 1774629473.253286, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988916') HTTP/1.1" 204 0
2026-03-27 16:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: aec951e5-0951-511c-9678-c638780da3e3 with identifier: 1988912
2026-03-27 16:37:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: aec951e5-0951-511c-9678-c638780da3e3 with identifier: 1988912
2026-03-27 16:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: aec951e5-0951-511c-9678-c638780da3e3 with identifier: 1988912 to the API
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'R COMMENT',
'currency': 'EUR',
'doors_number': 2,
'engine': '0.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'aec951e5-0951-511c-9678-c638780da3e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PIAGGIO',
'model': 'PIAGGIO LIBERTY 125 DELIVERY (DOUBLE RACK+BOX) Motociclo (Euro 4)',
'odometer': 16972,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571081,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555642,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec951e5-0951-511c-9678-c638780da3e3/aec951e5-0951-511c-9678-c638780da3e3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es8/927915a197ee4742bfd246c9279032e6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'PIAGGIO PIAGGIO LIBERTY 125 DELIVERY (DOUBLE RACK+BOX) Motociclo '
'(Euro 4) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988912%27 HTTP/1.1" 200 None
2026-03-27 16:37:53 [ayvens.it] INFO: Saving data for 1988912: {'created_time': 1774629473.714006, 'last_price_update_time': 1774629473.714016, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988912') HTTP/1.1" 204 0
2026-03-27 16:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0ee61d1a-f235-5fd7-9a98-347822e652ca with identifier: 1988914
2026-03-27 16:37:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0ee61d1a-f235-5fd7-9a98-347822e652ca with identifier: 1988914
2026-03-27 16:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0ee61d1a-f235-5fd7-9a98-347822e652ca with identifier: 1988914 to the API
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO SELENITE METALLIZZATA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '0ee61d1a-f235-5fd7-9a98-347822e652ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES-BENZ GLC 220 d 4Matic Sport aut. Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 155995,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752675,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 729944,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752675,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 732766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590976,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee61d1a-f235-5fd7-9a98-347822e652ca/0ee61d1a-f235-5fd7-9a98-347822e652ca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc0/70d357044cd84fe09330288944c92f32/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES-BENZ GLC 220 d 4Matic Sport aut. Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988914%27 HTTP/1.1" 200 None
2026-03-27 16:37:54 [ayvens.it] INFO: Saving data for 1988914: {'created_time': 1774629474.09209, 'last_price_update_time': 1774629474.092101, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988914') HTTP/1.1" 204 0
2026-03-27 16:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a8114194-e648-5593-8945-aba28a51701c with identifier: 1988913
2026-03-27 16:37:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a8114194-e648-5593-8945-aba28a51701c with identifier: 1988913
2026-03-27 16:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a8114194-e648-5593-8945-aba28a51701c with identifier: 1988913 to the API
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'COOL WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'a8114194-e648-5593-8945-aba28a51701c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA AYGO 1.0 VVT-i x-business MMT Micro car 5-door',
'odometer': 51735,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 617586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549918,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553605,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571590,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8114194-e648-5593-8945-aba28a51701c/a8114194-e648-5593-8945-aba28a51701c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm2/2174638c4b5d4795bd3597738a2a8f29/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-10',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA AYGO 1.0 VVT-i x-business MMT Micro car 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988913%27 HTTP/1.1" 200 None
2026-03-27 16:37:54 [ayvens.it] INFO: Saving data for 1988913: {'created_time': 1774629474.484506, 'last_price_update_time': 1774629474.484517, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988913') HTTP/1.1" 204 0
2026-03-27 16:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdc710>
2026-03-27 16:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/5.jpg saved to cache
2026-03-27 16:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:37:54 [ayvens.it] INFO: Found listing with ID: 1984741
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984741%27 HTTP/1.1" 200 None
2026-03-27 16:37:54 [ayvens.it] INFO: Scrape type for 1984741: 2
2026-03-27 16:37:54 [ayvens.it] INFO: Extracting data for car ID: 1984741
2026-03-27 16:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e592b31-fcbc-5c96-94ba-d5b601bc15fd with identifier: 1984741
2026-03-27 16:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e592b31-fcbc-5c96-94ba-d5b601bc15fd with scrape type 2
2026-03-27 16:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e592b31-fcbc-5c96-94ba-d5b601bc15fd with scrape type 2
2026-03-27 16:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2e592b31-fcbc-5c96-94ba-d5b601bc15fd, identifier: 1984741
2026-03-27 16:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69488350>
2026-03-27 16:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs4%252F48480b04ebe049abafa5bba3b61993cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/4.jpg saved to cache
2026-03-27 16:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f
2026-03-27 16:37:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e0f1b52-cd79-5907-a504-d03ce3217f5f, skipping ID generation
2026-03-27 16:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f with scrape type 1
2026-03-27 16:37:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e0f1b52-cd79-5907-a504-d03ce3217f5f sending to next pipeline
2026-03-27 16:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1e0f1b52-cd79-5907-a504-d03ce3217f5f, identifier: 1988911
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69688d10>
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/8.jpg saved to cache
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69408250>
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh5%252F4f6388797a8a4ca0bf71e505ea264e7c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/4.jpg saved to cache
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af60076f-7b2a-5ee2-aa7f-31347f615641
2026-03-27 16:37:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af60076f-7b2a-5ee2-aa7f-31347f615641, skipping ID generation
2026-03-27 16:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af60076f-7b2a-5ee2-aa7f-31347f615641 with scrape type 1
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af60076f-7b2a-5ee2-aa7f-31347f615641 sending to next pipeline
2026-03-27 16:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af60076f-7b2a-5ee2-aa7f-31347f615641, identifier: 1988910
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68515b90>
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga9%252F6d24bed9349f4a3b9e7a92040341ca00%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/7.jpg saved to cache
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17138f5a-8876-53e5-9d35-3e01c34eb488
2026-03-27 16:37:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17138f5a-8876-53e5-9d35-3e01c34eb488, skipping ID generation
2026-03-27 16:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17138f5a-8876-53e5-9d35-3e01c34eb488 with scrape type 1
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17138f5a-8876-53e5-9d35-3e01c34eb488 sending to next pipeline
2026-03-27 16:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 17138f5a-8876-53e5-9d35-3e01c34eb488, identifier: 1988884
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b71490>
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/8.jpg saved to cache
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6968a750>
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge3%252F0ebd4172f5b4447b8bc88f4cfde4aebb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/7.jpg saved to cache
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac220478-7c47-5d52-b723-fd3c48b4f816
2026-03-27 16:37:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac220478-7c47-5d52-b723-fd3c48b4f816, skipping ID generation
2026-03-27 16:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac220478-7c47-5d52-b723-fd3c48b4f816 with scrape type 1
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac220478-7c47-5d52-b723-fd3c48b4f816 sending to next pipeline
2026-03-27 16:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ac220478-7c47-5d52-b723-fd3c48b4f816, identifier: 1988883
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68517f50>
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj1%252F068f92a455f34fc9a1d92c4993077c28%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/9.jpg saved to cache
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 483367a7-9424-5972-b06a-1bbfe0906820
2026-03-27 16:37:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 483367a7-9424-5972-b06a-1bbfe0906820, skipping ID generation
2026-03-27 16:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483367a7-9424-5972-b06a-1bbfe0906820 with scrape type 1
2026-03-27 16:37:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 483367a7-9424-5972-b06a-1bbfe0906820 sending to next pipeline
2026-03-27 16:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 483367a7-9424-5972-b06a-1bbfe0906820, identifier: 1988881
2026-03-27 16:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2e592b31-fcbc-5c96-94ba-d5b601bc15fd with identifier: 1984741
2026-03-27 16:37:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2e592b31-fcbc-5c96-94ba-d5b601bc15fd with identifier: 1984741
2026-03-27 16:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2e592b31-fcbc-5c96-94ba-d5b601bc15fd with identifier: 1984741 to the API
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'URBAN BLUE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '2e592b31-fcbc-5c96-94ba-d5b601bc15fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA YARIS Hybrid Business MY20 Hatchback 5-door (Euro 6D)',
'odometer': 128503,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-22',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA YARIS Hybrid Business MY20 Hatchback 5-door (Euro 6D) '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984741%27 HTTP/1.1" 200 None
2026-03-27 16:37:56 [ayvens.it] INFO: Saving data for 1984741: {'auction_closing_time': 1774859400.0, 'created_time': 1774542740.547371, 'last_price_update_time': 1774629476.09145}
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984741') HTTP/1.1" 204 0
2026-03-27 16:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1e0f1b52-cd79-5907-a504-d03ce3217f5f with identifier: 1988911
2026-03-27 16:37:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1e0f1b52-cd79-5907-a504-d03ce3217f5f with identifier: 1988911
2026-03-27 16:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1e0f1b52-cd79-5907-a504-d03ce3217f5f with identifier: 1988911 to the API
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio Grafite metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '1e0f1b52-cd79-5907-a504-d03ce3217f5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT KOLEOS 2.0 DCI 175 ENERGY INI. PARIS 4X4 X-TRON Cross over '
'5-door (Euro 6)',
'odometer': 110422,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861453,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861453,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758684,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 824514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 722104,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 653058,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735419,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e0f1b52-cd79-5907-a504-d03ce3217f5f/1e0f1b52-cd79-5907-a504-d03ce3217f5f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707097,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs4/48480b04ebe049abafa5bba3b61993cc/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT KOLEOS 2.0 DCI 175 ENERGY INI. PARIS 4X4 X-TRON '
'Cross over 5-door (Euro 6) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988911%27 HTTP/1.1" 200 None
2026-03-27 16:37:56 [ayvens.it] INFO: Saving data for 1988911: {'created_time': 1774629476.467066, 'last_price_update_time': 1774629476.467077, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988911') HTTP/1.1" 204 0
2026-03-27 16:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af60076f-7b2a-5ee2-aa7f-31347f615641 with identifier: 1988910
2026-03-27 16:37:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af60076f-7b2a-5ee2-aa7f-31347f615641 with identifier: 1988910
2026-03-27 16:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af60076f-7b2a-5ee2-aa7f-31347f615641 with identifier: 1988910 to the API
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO MADREPERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'af60076f-7b2a-5ee2-aa7f-31347f615641',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 N1 BLUEHDI 130 S&S ACTIVE BUSINESS FP',
'odometer': 105299,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555654,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af60076f-7b2a-5ee2-aa7f-31347f615641/af60076f-7b2a-5ee2-aa7f-31347f615641_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh5/4f6388797a8a4ca0bf71e505ea264e7c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 N1 BLUEHDI 130 S&S ACTIVE BUSINESS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988910%27 HTTP/1.1" 200 None
2026-03-27 16:37:56 [ayvens.it] INFO: Saving data for 1988910: {'created_time': 1774629476.757336, 'last_price_update_time': 1774629476.757346, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988910') HTTP/1.1" 204 0
2026-03-27 16:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 17138f5a-8876-53e5-9d35-3e01c34eb488 with identifier: 1988884
2026-03-27 16:37:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 17138f5a-8876-53e5-9d35-3e01c34eb488 with identifier: 1988884
2026-03-27 16:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 17138f5a-8876-53e5-9d35-3e01c34eb488 with identifier: 1988884 to the API
2026-03-27 16:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'INDIUM GREY METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '17138f5a-8876-53e5-9d35-3e01c34eb488',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW SPORT BMT 4MOTION DSG FP',
'odometer': 127906,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628904,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626534,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628904,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17138f5a-8876-53e5-9d35-3e01c34eb488/17138f5a-8876-53e5-9d35-3e01c34eb488_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga9/6d24bed9349f4a3b9e7a92040341ca00/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW SPORT BMT '
'4MOTION DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988884%27 HTTP/1.1" 200 None
2026-03-27 16:37:57 [ayvens.it] INFO: Saving data for 1988884: {'created_time': 1774629477.234847, 'last_price_update_time': 1774629477.234857, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988884') HTTP/1.1" 204 0
2026-03-27 16:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ac220478-7c47-5d52-b723-fd3c48b4f816 with identifier: 1988883
2026-03-27 16:37:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ac220478-7c47-5d52-b723-fd3c48b4f816 with identifier: 1988883
2026-03-27 16:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ac220478-7c47-5d52-b723-fd3c48b4f816 with identifier: 1988883 to the API
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'P',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'ac220478-7c47-5d52-b723-fd3c48b4f816',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 xDrive 25e Business Advantage automatico Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 93525,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580340,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac220478-7c47-5d52-b723-fd3c48b4f816/ac220478-7c47-5d52-b723-fd3c48b4f816_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge3/0ebd4172f5b4447b8bc88f4cfde4aebb/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 xDrive 25e Business Advantage automatico Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988883%27 HTTP/1.1" 200 None
2026-03-27 16:37:57 [ayvens.it] INFO: Saving data for 1988883: {'created_time': 1774629477.587916, 'last_price_update_time': 1774629477.587926, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988883') HTTP/1.1" 204 0
2026-03-27 16:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 483367a7-9424-5972-b06a-1bbfe0906820 with identifier: 1988881
2026-03-27 16:37:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 483367a7-9424-5972-b06a-1bbfe0906820 with identifier: 1988881
2026-03-27 16:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 483367a7-9424-5972-b06a-1bbfe0906820 with identifier: 1988881 to the API
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SCHWARZ PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '483367a7-9424-5972-b06a-1bbfe0906820',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIES 3 SW 320D XDRIVE 48V BUS.ADV. TOURING AUT FP',
'odometer': 130806,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 737261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 617099,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483367a7-9424-5972-b06a-1bbfe0906820/483367a7-9424-5972-b06a-1bbfe0906820_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj1/068f92a455f34fc9a1d92c4993077c28/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIES 3 SW 320D XDRIVE 48V BUS.ADV. TOURING AUT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988881%27 HTTP/1.1" 200 None
2026-03-27 16:37:57 [ayvens.it] INFO: Saving data for 1988881: {'created_time': 1774629477.878254, 'last_price_update_time': 1774629477.878266, 'auction_closing_time': 1774944000.0}
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988881') HTTP/1.1" 204 0
2026-03-27 16:37:57 [ayvens.it] INFO: Found listing with ID: 1984742
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984742%27 HTTP/1.1" 200 None
2026-03-27 16:37:57 [ayvens.it] INFO: Scrape type for 1984742: 2
2026-03-27 16:37:57 [ayvens.it] INFO: Extracting data for car ID: 1984742
2026-03-27 16:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 130a6b07-3dd6-57de-b76a-a60c53cbebb8 with identifier: 1984742
2026-03-27 16:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 130a6b07-3dd6-57de-b76a-a60c53cbebb8 with scrape type 2
2026-03-27 16:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 130a6b07-3dd6-57de-b76a-a60c53cbebb8 with scrape type 2
2026-03-27 16:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 130a6b07-3dd6-57de-b76a-a60c53cbebb8, identifier: 1984742
2026-03-27 16:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 130a6b07-3dd6-57de-b76a-a60c53cbebb8 with identifier: 1984742
2026-03-27 16:37:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 130a6b07-3dd6-57de-b76a-a60c53cbebb8 with identifier: 1984742
2026-03-27 16:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 130a6b07-3dd6-57de-b76a-a60c53cbebb8 with identifier: 1984742 to the API
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO ONYX',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '130a6b07-3dd6-57de-b76a-a60c53cbebb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C4 SPACETOURER BLUEHDI 130 S&S EAT8 FEEL N1 FP',
'odometer': 74405,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C4 SPACETOURER BLUEHDI 130 S&S EAT8 FEEL N1 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984742%27 HTTP/1.1" 200 None
2026-03-27 16:37:58 [ayvens.it] INFO: Saving data for 1984742: {'auction_closing_time': 1774859400.0, 'created_time': 1774542742.012923, 'last_price_update_time': 1774629478.333373}
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984742') HTTP/1.1" 204 0
2026-03-27 16:37:58 [ayvens.it] INFO: Found listing with ID: 1984743
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984743%27 HTTP/1.1" 200 None
2026-03-27 16:37:58 [ayvens.it] INFO: Scrape type for 1984743: 2
2026-03-27 16:37:58 [ayvens.it] INFO: Extracting data for car ID: 1984743
2026-03-27 16:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2226a90-2bd5-5f97-9eb5-a94538ee86ea with identifier: 1984743
2026-03-27 16:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2226a90-2bd5-5f97-9eb5-a94538ee86ea with scrape type 2
2026-03-27 16:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2226a90-2bd5-5f97-9eb5-a94538ee86ea with scrape type 2
2026-03-27 16:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e2226a90-2bd5-5f97-9eb5-a94538ee86ea, identifier: 1984743
2026-03-27 16:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e2226a90-2bd5-5f97-9eb5-a94538ee86ea with identifier: 1984743
2026-03-27 16:37:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e2226a90-2bd5-5f97-9eb5-a94538ee86ea with identifier: 1984743
2026-03-27 16:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e2226a90-2bd5-5f97-9eb5-a94538ee86ea with identifier: 1984743 to the API
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DEEP CRYSTAL BLUE',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'e2226a90-2bd5-5f97-9eb5-a94538ee86ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MAZDA',
'model': 'MAZDA CX-5 DIESEL 2.2L 150CV 2WD 6MT BUSINESS FP',
'odometer': 71528,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'MAZDA MAZDA CX-5 DIESEL 2.2L 150CV 2WD 6MT BUSINESS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984743%27 HTTP/1.1" 200 None
2026-03-27 16:37:58 [ayvens.it] INFO: Saving data for 1984743: {'auction_closing_time': 1774859400.0, 'created_time': 1774542744.059425, 'last_price_update_time': 1774629478.702356}
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984743') HTTP/1.1" 204 0
2026-03-27 16:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:58 [ayvens.it] INFO: Found listing with ID: 1984744
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984744%27 HTTP/1.1" 200 None
2026-03-27 16:37:58 [ayvens.it] INFO: Scrape type for 1984744: 2
2026-03-27 16:37:58 [ayvens.it] INFO: Extracting data for car ID: 1984744
2026-03-27 16:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c5ed42e-3cdf-551d-88cf-ab83bb9d05b7 with identifier: 1984744
2026-03-27 16:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c5ed42e-3cdf-551d-88cf-ab83bb9d05b7 with scrape type 2
2026-03-27 16:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c5ed42e-3cdf-551d-88cf-ab83bb9d05b7 with scrape type 2
2026-03-27 16:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0c5ed42e-3cdf-551d-88cf-ab83bb9d05b7, identifier: 1984744
2026-03-27 16:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0c5ed42e-3cdf-551d-88cf-ab83bb9d05b7 with identifier: 1984744
2026-03-27 16:37:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0c5ed42e-3cdf-551d-88cf-ab83bb9d05b7 with identifier: 1984744
2026-03-27 16:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0c5ed42e-3cdf-551d-88cf-ab83bb9d05b7 with identifier: 1984744 to the API
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU MONTECARLO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '0c5ed42e-3cdf-551d-88cf-ab83bb9d05b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO (PC) 2.2 TURBO DIESEL 160CV AT8 RWD BUSINESS FP',
'odometer': 109806,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO (PC) 2.2 TURBO DIESEL 160CV AT8 RWD '
'BUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984744%27 HTTP/1.1" 200 None
2026-03-27 16:37:59 [ayvens.it] INFO: Saving data for 1984744: {'auction_closing_time': 1774859400.0, 'created_time': 1774542745.893892, 'last_price_update_time': 1774629479.061498}
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984744') HTTP/1.1" 204 0
2026-03-27 16:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:59 [ayvens.it] INFO: Found listing with ID: 1984745
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984745%27 HTTP/1.1" 200 None
2026-03-27 16:37:59 [ayvens.it] INFO: Scrape type for 1984745: 2
2026-03-27 16:37:59 [ayvens.it] INFO: Extracting data for car ID: 1984745
2026-03-27 16:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16192747-f499-56ac-a173-1304eed6767f with identifier: 1984745
2026-03-27 16:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16192747-f499-56ac-a173-1304eed6767f with scrape type 2
2026-03-27 16:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16192747-f499-56ac-a173-1304eed6767f with scrape type 2
2026-03-27 16:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 16192747-f499-56ac-a173-1304eed6767f, identifier: 1984745
2026-03-27 16:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 16192747-f499-56ac-a173-1304eed6767f with identifier: 1984745
2026-03-27 16:37:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 16192747-f499-56ac-a173-1304eed6767f with identifier: 1984745
2026-03-27 16:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 16192747-f499-56ac-a173-1304eed6767f with identifier: 1984745 to the API
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '16192747-f499-56ac-a173-1304eed6767f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 1.5 EcoBlue 120CV 2WD Titanium Business Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 89132,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 1.5 EcoBlue 120CV 2WD Titanium Business Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984745%27 HTTP/1.1" 200 None
2026-03-27 16:37:59 [ayvens.it] INFO: Saving data for 1984745: {'auction_closing_time': 1774859400.0, 'created_time': 1774542747.833687, 'last_price_update_time': 1774629479.440054}
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984745') HTTP/1.1" 204 0
2026-03-27 16:37:59 [ayvens.it] INFO: Found listing with ID: 1984746
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984746%27 HTTP/1.1" 200 None
2026-03-27 16:37:59 [ayvens.it] INFO: Scrape type for 1984746: 2
2026-03-27 16:37:59 [ayvens.it] INFO: Extracting data for car ID: 1984746
2026-03-27 16:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4b613d-e3e9-5858-b2cd-b0acd2af687e with identifier: 1984746
2026-03-27 16:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4b613d-e3e9-5858-b2cd-b0acd2af687e with scrape type 2
2026-03-27 16:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a4b613d-e3e9-5858-b2cd-b0acd2af687e with scrape type 2
2026-03-27 16:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7a4b613d-e3e9-5858-b2cd-b0acd2af687e, identifier: 1984746
2026-03-27 16:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7a4b613d-e3e9-5858-b2cd-b0acd2af687e with identifier: 1984746
2026-03-27 16:37:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7a4b613d-e3e9-5858-b2cd-b0acd2af687e with identifier: 1984746
2026-03-27 16:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7a4b613d-e3e9-5858-b2cd-b0acd2af687e with identifier: 1984746 to the API
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PEBBLE GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '7a4b613d-e3e9-5858-b2cd-b0acd2af687e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 T5 PLUG-IN HYBRID AUTO RECHARGE INSCR. FP',
'odometer': 181735,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-09',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 T5 PLUG-IN HYBRID AUTO RECHARGE INSCR. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984746%27 HTTP/1.1" 200 None
2026-03-27 16:37:59 [ayvens.it] INFO: Saving data for 1984746: {'auction_closing_time': 1774859400.0, 'created_time': 1774542749.978794, 'last_price_update_time': 1774629479.815246}
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984746') HTTP/1.1" 204 0
2026-03-27 16:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691431d0>
2026-03-27 16:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/2.jpg saved to cache
2026-03-27 16:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69141550>
2026-03-27 16:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/2.jpg saved to cache
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa190d0>
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/3.jpg saved to cache
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6aa19750>
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge1%252Fcf39ab8838d344bca4d717435c2a0b02%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/10.jpg saved to cache
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79d46067-3fd5-5265-81d8-941b4602a013
2026-03-27 16:38:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79d46067-3fd5-5265-81d8-941b4602a013, skipping ID generation
2026-03-27 16:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d46067-3fd5-5265-81d8-941b4602a013 with scrape type 1
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79d46067-3fd5-5265-81d8-941b4602a013 sending to next pipeline
2026-03-27 16:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 79d46067-3fd5-5265-81d8-941b4602a013, identifier: 1988879
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5e7d0>
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/4.jpg saved to cache
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:38:00 [ayvens.it] INFO: Found listing with ID: 1984747
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984747%27 HTTP/1.1" 200 None
2026-03-27 16:38:00 [ayvens.it] INFO: Scrape type for 1984747: 2
2026-03-27 16:38:00 [ayvens.it] INFO: Extracting data for car ID: 1984747
2026-03-27 16:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c0fb7bc-7398-5d85-8404-195c6e1d927d with identifier: 1984747
2026-03-27 16:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c0fb7bc-7398-5d85-8404-195c6e1d927d with scrape type 2
2026-03-27 16:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c0fb7bc-7398-5d85-8404-195c6e1d927d with scrape type 2
2026-03-27 16:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8c0fb7bc-7398-5d85-8404-195c6e1d927d, identifier: 1984747
2026-03-27 16:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 79d46067-3fd5-5265-81d8-941b4602a013 with identifier: 1988879
2026-03-27 16:38:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 79d46067-3fd5-5265-81d8-941b4602a013 with identifier: 1988879
2026-03-27 16:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 79d46067-3fd5-5265-81d8-941b4602a013 with identifier: 1988879 to the API
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Generic Color',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '79d46067-3fd5-5265-81d8-941b4602a013',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 2.0 P300 MHEV R-DYNAMIC SE AWD AUTO FP',
'odometer': 45536,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675694,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488516,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d46067-3fd5-5265-81d8-941b4602a013/79d46067-3fd5-5265-81d8-941b4602a013_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge1/cf39ab8838d344bca4d717435c2a0b02/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-15',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 2.0 P300 MHEV R-DYNAMIC SE '
'AWD AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988879%27 HTTP/1.1" 200 None
2026-03-27 16:38:00 [ayvens.it] INFO: Saving data for 1988879: {'created_time': 1774629480.793439, 'last_price_update_time': 1774629480.793453, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988879') HTTP/1.1" 204 0
2026-03-27 16:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8c0fb7bc-7398-5d85-8404-195c6e1d927d with identifier: 1984747
2026-03-27 16:38:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8c0fb7bc-7398-5d85-8404-195c6e1d927d with identifier: 1984747
2026-03-27 16:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8c0fb7bc-7398-5d85-8404-195c6e1d927d with identifier: 1984747 to the API
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO MAESTRO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '8c0fb7bc-7398-5d85-8404-195c6e1d927d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA (PC) 1.0 FIREFLY 70CV S&S HYBRID FP',
'odometer': 40795,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA (PC) 1.0 FIREFLY 70CV S&S HYBRID FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984747%27 HTTP/1.1" 200 None
2026-03-27 16:38:01 [ayvens.it] INFO: Saving data for 1984747: {'auction_closing_time': 1774859400.0, 'created_time': 1774542751.75693, 'last_price_update_time': 1774629481.075073}
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984747') HTTP/1.1" 204 0
2026-03-27 16:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692dc710>
2026-03-27 16:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/3.jpg saved to cache
2026-03-27 16:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0f3d0>
2026-03-27 16:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc6%252Feb0c4ff7af894285bd0765f8ec419d47%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/1.jpg saved to cache
2026-03-27 16:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100
2026-03-27 16:38:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d2143ed-9432-5b83-a60a-a9f9f2c07100, skipping ID generation
2026-03-27 16:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with scrape type 1
2026-03-27 16:38:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d2143ed-9432-5b83-a60a-a9f9f2c07100 sending to next pipeline
2026-03-27 16:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9d2143ed-9432-5b83-a60a-a9f9f2c07100, identifier: 1988878
2026-03-27 16:38:01 [ayvens.it] INFO: Found listing with ID: 1984748
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984748%27 HTTP/1.1" 200 None
2026-03-27 16:38:01 [ayvens.it] INFO: Scrape type for 1984748: 2
2026-03-27 16:38:01 [ayvens.it] INFO: Extracting data for car ID: 1984748
2026-03-27 16:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a59b428d-bd65-52d9-847f-9f9a9f492850 with identifier: 1984748
2026-03-27 16:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a59b428d-bd65-52d9-847f-9f9a9f492850 with scrape type 2
2026-03-27 16:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a59b428d-bd65-52d9-847f-9f9a9f492850 with scrape type 2
2026-03-27 16:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a59b428d-bd65-52d9-847f-9f9a9f492850, identifier: 1984748
2026-03-27 16:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with identifier: 1988878
2026-03-27 16:38:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with identifier: 1988878
2026-03-27 16:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9d2143ed-9432-5b83-a60a-a9f9f2c07100 with identifier: 1988878 to the API
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Noir Perla Metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '9d2143ed-9432-5b83-a60a-a9f9f2c07100',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over 5-door '
'(Euro 6D)',
'odometer': 109269,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601733,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601733,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560724,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2143ed-9432-5b83-a60a-a9f9f2c07100/9d2143ed-9432-5b83-a60a-a9f9f2c07100_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556385,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc6/eb0c4ff7af894285bd0765f8ec419d47/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988878%27 HTTP/1.1" 200 None
2026-03-27 16:38:01 [ayvens.it] INFO: Saving data for 1988878: {'created_time': 1774629481.735905, 'last_price_update_time': 1774629481.735915, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988878') HTTP/1.1" 204 0
2026-03-27 16:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a59b428d-bd65-52d9-847f-9f9a9f492850 with identifier: 1984748
2026-03-27 16:38:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a59b428d-bd65-52d9-847f-9f9a9f492850 with identifier: 1984748
2026-03-27 16:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a59b428d-bd65-52d9-847f-9f9a9f492850 with identifier: 1984748 to the API
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Moondust Silver metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'a59b428d-bd65-52d9-847f-9f9a9f492850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 115cv ST -Line Auto SW SW 5-door (Euro 6D)',
'odometer': 42562,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 115cv ST -Line Auto SW SW 5-door (Euro '
'6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984748%27 HTTP/1.1" 200 None
2026-03-27 16:38:02 [ayvens.it] INFO: Saving data for 1984748: {'auction_closing_time': 1774859400.0, 'created_time': 1774542753.836083, 'last_price_update_time': 1774629482.025473}
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984748') HTTP/1.1" 204 0
2026-03-27 16:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ad0d4d0>
2026-03-27 16:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh3%252F216e85521ffd4050a710d1015d9ba85a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/1.jpg saved to cache
2026-03-27 16:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8266c022-3d29-5bf4-b747-4794e2a2c615
2026-03-27 16:38:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8266c022-3d29-5bf4-b747-4794e2a2c615, skipping ID generation
2026-03-27 16:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8266c022-3d29-5bf4-b747-4794e2a2c615 with scrape type 1
2026-03-27 16:38:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8266c022-3d29-5bf4-b747-4794e2a2c615 sending to next pipeline
2026-03-27 16:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8266c022-3d29-5bf4-b747-4794e2a2c615, identifier: 1988880
2026-03-27 16:38:02 [ayvens.it] INFO: Found listing with ID: 1984749
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984749%27 HTTP/1.1" 200 None
2026-03-27 16:38:02 [ayvens.it] INFO: Scrape type for 1984749: 2
2026-03-27 16:38:02 [ayvens.it] INFO: Extracting data for car ID: 1984749
2026-03-27 16:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0dcf99d-e1c4-5334-a674-ace6bd7b9951 with identifier: 1984749
2026-03-27 16:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0dcf99d-e1c4-5334-a674-ace6bd7b9951 with scrape type 2
2026-03-27 16:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0dcf99d-e1c4-5334-a674-ace6bd7b9951 with scrape type 2
2026-03-27 16:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c0dcf99d-e1c4-5334-a674-ace6bd7b9951, identifier: 1984749
2026-03-27 16:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8266c022-3d29-5bf4-b747-4794e2a2c615 with identifier: 1988880
2026-03-27 16:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8266c022-3d29-5bf4-b747-4794e2a2c615 with identifier: 1988880
2026-03-27 16:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8266c022-3d29-5bf4-b747-4794e2a2c615 with identifier: 1988880 to the API
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '8266c022-3d29-5bf4-b747-4794e2a2c615',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina PHEV 225CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 70325,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 807816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8266c022-3d29-5bf4-b747-4794e2a2c615/8266c022-3d29-5bf4-b747-4794e2a2c615_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470221,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh3/216e85521ffd4050a710d1015d9ba85a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina PHEV 225CV 2WD ST-Line Aut Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988880%27 HTTP/1.1" 200 None
2026-03-27 16:38:02 [ayvens.it] INFO: Saving data for 1988880: {'created_time': 1774629482.592812, 'last_price_update_time': 1774629482.592823, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988880') HTTP/1.1" 204 0
2026-03-27 16:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c0dcf99d-e1c4-5334-a674-ace6bd7b9951 with identifier: 1984749
2026-03-27 16:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c0dcf99d-e1c4-5334-a674-ace6bd7b9951 with identifier: 1984749
2026-03-27 16:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c0dcf99d-e1c4-5334-a674-ace6bd7b9951 with identifier: 1984749 to the API
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MYTHOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'c0dcf99d-e1c4-5334-a674-ace6bd7b9951',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 (PC) 35 TDI S TRONIC BUSINESS FP',
'odometer': 164707,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 (PC) 35 TDI S TRONIC BUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984749%27 HTTP/1.1" 200 None
2026-03-27 16:38:02 [ayvens.it] INFO: Saving data for 1984749: {'auction_closing_time': 1774859400.0, 'created_time': 1774542755.783979, 'last_price_update_time': 1774629482.930602}
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984749') HTTP/1.1" 204 0
2026-03-27 16:38:02 [ayvens.it] INFO: Found listing with ID: 1984750
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984750%27 HTTP/1.1" 200 None
2026-03-27 16:38:02 [ayvens.it] INFO: Scrape type for 1984750: 2
2026-03-27 16:38:02 [ayvens.it] INFO: Extracting data for car ID: 1984750
2026-03-27 16:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689c4224-9abc-5b78-90dc-42dd0156a963 with identifier: 1984750
2026-03-27 16:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689c4224-9abc-5b78-90dc-42dd0156a963 with scrape type 2
2026-03-27 16:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689c4224-9abc-5b78-90dc-42dd0156a963 with scrape type 2
2026-03-27 16:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 689c4224-9abc-5b78-90dc-42dd0156a963, identifier: 1984750
2026-03-27 16:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 689c4224-9abc-5b78-90dc-42dd0156a963 with identifier: 1984750
2026-03-27 16:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 689c4224-9abc-5b78-90dc-42dd0156a963 with identifier: 1984750
2026-03-27 16:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 689c4224-9abc-5b78-90dc-42dd0156a963 with identifier: 1984750 to the API
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Agate Black metallizzato',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '689c4224-9abc-5b78-90dc-42dd0156a963',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD RANGER Wildtrak Auto 4WD 2.0 Ecoblue 205CV DC Autocarro cabina '
'doppia 4-door (Euro 6.2)',
'odometer': 25615,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-06',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD RANGER Wildtrak Auto 4WD 2.0 Ecoblue 205CV DC Autocarro '
'cabina doppia 4-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2025}
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984750%27 HTTP/1.1" 200 None
2026-03-27 16:38:03 [ayvens.it] INFO: Saving data for 1984750: {'auction_closing_time': 1774859400.0, 'created_time': 1774542756.959512, 'last_price_update_time': 1774629483.547421}
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984750') HTTP/1.1" 204 0
2026-03-27 16:38:03 [ayvens.it] INFO: Found listing with ID: 1984751
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984751%27 HTTP/1.1" 200 None
2026-03-27 16:38:03 [ayvens.it] INFO: Scrape type for 1984751: 2
2026-03-27 16:38:03 [ayvens.it] INFO: Extracting data for car ID: 1984751
2026-03-27 16:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b226d110-dd4f-5010-bb59-de9248c65304 with identifier: 1984751
2026-03-27 16:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b226d110-dd4f-5010-bb59-de9248c65304 with scrape type 2
2026-03-27 16:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b226d110-dd4f-5010-bb59-de9248c65304 with scrape type 2
2026-03-27 16:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b226d110-dd4f-5010-bb59-de9248c65304, identifier: 1984751
2026-03-27 16:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b226d110-dd4f-5010-bb59-de9248c65304 with identifier: 1984751
2026-03-27 16:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b226d110-dd4f-5010-bb59-de9248c65304 with identifier: 1984751
2026-03-27 16:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b226d110-dd4f-5010-bb59-de9248c65304 with identifier: 1984751 to the API
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'b226d110-dd4f-5010-bb59-de9248c65304',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT (PC) 350 L3H2 TREND 2.0 ECO 170 CV',
'odometer': 76314,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT (PC) 350 L3H2 TREND 2.0 ECO 170 CV -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984751%27 HTTP/1.1" 200 None
2026-03-27 16:38:03 [ayvens.it] INFO: Saving data for 1984751: {'auction_closing_time': 1774859400.0, 'created_time': 1774542758.6493, 'last_price_update_time': 1774629483.97947}
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984751') HTTP/1.1" 204 0
2026-03-27 16:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:04 [ayvens.it] INFO: Found listing with ID: 1984752
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984752%27 HTTP/1.1" 200 None
2026-03-27 16:38:04 [ayvens.it] INFO: Scrape type for 1984752: 2
2026-03-27 16:38:04 [ayvens.it] INFO: Extracting data for car ID: 1984752
2026-03-27 16:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd24dde0-9182-50ea-a766-422e0fecaf6d with identifier: 1984752
2026-03-27 16:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd24dde0-9182-50ea-a766-422e0fecaf6d with scrape type 2
2026-03-27 16:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd24dde0-9182-50ea-a766-422e0fecaf6d with scrape type 2
2026-03-27 16:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dd24dde0-9182-50ea-a766-422e0fecaf6d, identifier: 1984752
2026-03-27 16:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b09bd50>
2026-03-27 16:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs0%252F90ba68751fe2400783f78dfbfe2a44c1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/2.jpg saved to cache
2026-03-27 16:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95274bde-7267-5245-a4c3-bf013298eef0
2026-03-27 16:38:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95274bde-7267-5245-a4c3-bf013298eef0, skipping ID generation
2026-03-27 16:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95274bde-7267-5245-a4c3-bf013298eef0 with scrape type 1
2026-03-27 16:38:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95274bde-7267-5245-a4c3-bf013298eef0 sending to next pipeline
2026-03-27 16:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 95274bde-7267-5245-a4c3-bf013298eef0, identifier: 1988876
2026-03-27 16:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dd24dde0-9182-50ea-a766-422e0fecaf6d with identifier: 1984752
2026-03-27 16:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dd24dde0-9182-50ea-a766-422e0fecaf6d with identifier: 1984752
2026-03-27 16:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dd24dde0-9182-50ea-a766-422e0fecaf6d with identifier: 1984752 to the API
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'dd24dde0-9182-50ea-a766-422e0fecaf6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV BUSINESS SW FP',
'odometer': 150049,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.5 ECOBLUE 120CV BUSINESS SW FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984752%27 HTTP/1.1" 200 None
2026-03-27 16:38:04 [ayvens.it] INFO: Saving data for 1984752: {'auction_closing_time': 1774859400.0, 'created_time': 1774542760.849941, 'last_price_update_time': 1774629484.560577}
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984752') HTTP/1.1" 204 0
2026-03-27 16:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 95274bde-7267-5245-a4c3-bf013298eef0 with identifier: 1988876
2026-03-27 16:38:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 95274bde-7267-5245-a4c3-bf013298eef0 with identifier: 1988876
2026-03-27 16:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 95274bde-7267-5245-a4c3-bf013298eef0 with identifier: 1988876 to the API
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Digital White Metallic',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'electric',
'id': '95274bde-7267-5245-a4c3-bf013298eef0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SMART',
'model': 'SMART #1 66 kWh Pro+ Sport utility vehicle 5-door',
'odometer': 20443,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 69,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561859,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95274bde-7267-5245-a4c3-bf013298eef0/95274bde-7267-5245-a4c3-bf013298eef0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 466780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs0/90ba68751fe2400783f78dfbfe2a44c1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-09',
'seats_number': 5,
'seller_name': None,
'title': 'SMART SMART #1 66 kWh Pro+ Sport utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988876%27 HTTP/1.1" 200 None
2026-03-27 16:38:04 [ayvens.it] INFO: Saving data for 1988876: {'created_time': 1774629484.859586, 'last_price_update_time': 1774629484.859599, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988876') HTTP/1.1" 204 0
2026-03-27 16:38:04 [ayvens.it] INFO: Found listing with ID: 1984753
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984753%27 HTTP/1.1" 200 None
2026-03-27 16:38:04 [ayvens.it] INFO: Scrape type for 1984753: 2
2026-03-27 16:38:04 [ayvens.it] INFO: Extracting data for car ID: 1984753
2026-03-27 16:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05555777-9e47-5eae-83b5-ae379f1bf3bd with identifier: 1984753
2026-03-27 16:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05555777-9e47-5eae-83b5-ae379f1bf3bd with scrape type 2
2026-03-27 16:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05555777-9e47-5eae-83b5-ae379f1bf3bd with scrape type 2
2026-03-27 16:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 05555777-9e47-5eae-83b5-ae379f1bf3bd, identifier: 1984753
2026-03-27 16:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ca450>
2026-03-27 16:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/4.jpg saved to cache
2026-03-27 16:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68adf4d0>
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252Ffd111de0fc424a7ebc08555fa05e3ec8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/5.jpg saved to cache
2026-03-27 16:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3
2026-03-27 16:38:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3, skipping ID generation
2026-03-27 16:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with scrape type 1
2026-03-27 16:38:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 sending to next pipeline
2026-03-27 16:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3, identifier: 1988874
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69325410>
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/8.jpg saved to cache
2026-03-27 16:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c68890>
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/9.jpg saved to cache
2026-03-27 16:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 05555777-9e47-5eae-83b5-ae379f1bf3bd with identifier: 1984753
2026-03-27 16:38:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 05555777-9e47-5eae-83b5-ae379f1bf3bd with identifier: 1984753
2026-03-27 16:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 05555777-9e47-5eae-83b5-ae379f1bf3bd with identifier: 1984753 to the API
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Bianco Ghiaccio metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '05555777-9e47-5eae-83b5-ae379f1bf3bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 45 TFSI e S tronic Business Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 80348,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 45 TFSI e S tronic Business Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984753%27 HTTP/1.1" 200 None
2026-03-27 16:38:05 [ayvens.it] INFO: Saving data for 1984753: {'auction_closing_time': 1774859400.0, 'created_time': 1774542762.457615, 'last_price_update_time': 1774629485.852055}
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984753') HTTP/1.1" 204 0
2026-03-27 16:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with identifier: 1988874
2026-03-27 16:38:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with identifier: 1988874
2026-03-27 16:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3 with identifier: 1988874 to the API
2026-03-27 16:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PAST',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'HYUNDAI TUCSON (PC) 1.6 HEV 2WD 230CV XLINE AUTO FP',
'odometer': 123162,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 790135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606476,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3/2bac6ebb-51d7-5f21-8fb5-272dcf9f1ec3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/fd111de0fc424a7ebc08555fa05e3ec8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI HYUNDAI TUCSON (PC) 1.6 HEV 2WD 230CV XLINE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988874%27 HTTP/1.1" 200 None
2026-03-27 16:38:06 [ayvens.it] INFO: Saving data for 1988874: {'created_time': 1774629486.153617, 'last_price_update_time': 1774629486.153628, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988874') HTTP/1.1" 204 0
2026-03-27 16:38:06 [scrapy.extensions.logstats] INFO: Crawled 20 pages (at 2 pages/min), scraped 290 items (at 108 items/min)
2026-03-27 16:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-27 16:38:06 [ayvens.it] INFO: Found listing with ID: 1984754
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984754%27 HTTP/1.1" 200 None
2026-03-27 16:38:06 [ayvens.it] INFO: Scrape type for 1984754: 2
2026-03-27 16:38:06 [ayvens.it] INFO: Extracting data for car ID: 1984754
2026-03-27 16:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5000ce7b-d11a-5e23-866d-a4178ba285d1 with identifier: 1984754
2026-03-27 16:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5000ce7b-d11a-5e23-866d-a4178ba285d1 with scrape type 2
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5000ce7b-d11a-5e23-866d-a4178ba285d1 with scrape type 2
2026-03-27 16:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5000ce7b-d11a-5e23-866d-a4178ba285d1, identifier: 1984754
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68955690>
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt2%252F0af36c8f17014e4aa709ab24eaca81d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/5.jpg saved to cache
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9acdc625-040e-58de-8b6a-cf7077ee2720
2026-03-27 16:38:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9acdc625-040e-58de-8b6a-cf7077ee2720, skipping ID generation
2026-03-27 16:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acdc625-040e-58de-8b6a-cf7077ee2720 with scrape type 1
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9acdc625-040e-58de-8b6a-cf7077ee2720 sending to next pipeline
2026-03-27 16:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9acdc625-040e-58de-8b6a-cf7077ee2720, identifier: 1988873
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c8ff50>
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr3%252F01fce003f1d242c79eab85c8a4ea38c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/2.jpg saved to cache
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fac2ddc5-df99-556a-929e-2e2894efcd2b
2026-03-27 16:38:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fac2ddc5-df99-556a-929e-2e2894efcd2b, skipping ID generation
2026-03-27 16:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac2ddc5-df99-556a-929e-2e2894efcd2b with scrape type 1
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fac2ddc5-df99-556a-929e-2e2894efcd2b sending to next pipeline
2026-03-27 16:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: fac2ddc5-df99-556a-929e-2e2894efcd2b, identifier: 1988875
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c3c890>
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj0%252F11965685beb54a38b91c3152e07ccdb8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/7.jpg saved to cache
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 544cea6d-c67e-5a30-91cf-5a32d6330c30
2026-03-27 16:38:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 544cea6d-c67e-5a30-91cf-5a32d6330c30, skipping ID generation
2026-03-27 16:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 544cea6d-c67e-5a30-91cf-5a32d6330c30 with scrape type 1
2026-03-27 16:38:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 544cea6d-c67e-5a30-91cf-5a32d6330c30 sending to next pipeline
2026-03-27 16:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 544cea6d-c67e-5a30-91cf-5a32d6330c30, identifier: 1988858
2026-03-27 16:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5000ce7b-d11a-5e23-866d-a4178ba285d1 with identifier: 1984754
2026-03-27 16:38:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5000ce7b-d11a-5e23-866d-a4178ba285d1 with identifier: 1984754
2026-03-27 16:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5000ce7b-d11a-5e23-866d-a4178ba285d1 with identifier: 1984754 to the API
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO TIZIANO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '5000ce7b-d11a-5e23-866d-a4178ba285d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO (PC) 33 MH2 2.2 MJT3 120CV E6D-FIN',
'odometer': 89066,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO (PC) 33 MH2 2.2 MJT3 120CV E6D-FIN -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984754%27 HTTP/1.1" 200 None
2026-03-27 16:38:07 [ayvens.it] INFO: Saving data for 1984754: {'auction_closing_time': 1774859400.0, 'created_time': 1774542763.878584, 'last_price_update_time': 1774629487.257673}
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984754') HTTP/1.1" 204 0
2026-03-27 16:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9acdc625-040e-58de-8b6a-cf7077ee2720 with identifier: 1988873
2026-03-27 16:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9acdc625-040e-58de-8b6a-cf7077ee2720 with identifier: 1988873
2026-03-27 16:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9acdc625-040e-58de-8b6a-cf7077ee2720 with identifier: 1988873 to the API
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE CELEBES METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '9acdc625-040e-58de-8b6a-cf7077ee2720',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP',
'odometer': 41925,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 841179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdc625-040e-58de-8b6a-cf7077ee2720/9acdc625-040e-58de-8b6a-cf7077ee2720_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt2/0af36c8f17014e4aa709ab24eaca81d4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ALLURE PACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988873%27 HTTP/1.1" 200 None
2026-03-27 16:38:07 [ayvens.it] INFO: Saving data for 1988873: {'created_time': 1774629487.661839, 'last_price_update_time': 1774629487.66185, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988873') HTTP/1.1" 204 0
2026-03-27 16:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: fac2ddc5-df99-556a-929e-2e2894efcd2b with identifier: 1988875
2026-03-27 16:38:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: fac2ddc5-df99-556a-929e-2e2894efcd2b with identifier: 1988875
2026-03-27 16:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: fac2ddc5-df99-556a-929e-2e2894efcd2b with identifier: 1988875 to the API
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'QPA',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': 'fac2ddc5-df99-556a-929e-2e2894efcd2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT ARKANA 1.6 Hybrid 105KW E-TECH TECHNO Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 94623,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 783298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 783298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781107,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 798515,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 803333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686047,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 784687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2ddc5-df99-556a-929e-2e2894efcd2b/fac2ddc5-df99-556a-929e-2e2894efcd2b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr3/01fce003f1d242c79eab85c8a4ea38c8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT ARKANA 1.6 Hybrid 105KW E-TECH TECHNO Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988875%27 HTTP/1.1" 200 None
2026-03-27 16:38:08 [ayvens.it] INFO: Saving data for 1988875: {'created_time': 1774629488.071851, 'last_price_update_time': 1774629488.071863, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988875') HTTP/1.1" 204 0
2026-03-27 16:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 544cea6d-c67e-5a30-91cf-5a32d6330c30 with identifier: 1988858
2026-03-27 16:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 544cea6d-c67e-5a30-91cf-5a32d6330c30 with identifier: 1988858
2026-03-27 16:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 544cea6d-c67e-5a30-91cf-5a32d6330c30 with identifier: 1988858 to the API
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '544cea6d-c67e-5a30-91cf-5a32d6330c30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X2 SDRIVE 18D BUSINESS X FP',
'odometer': 110585,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 767878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 767878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_544cea6d-c67e-5a30-91cf-5a32d6330c30/544cea6d-c67e-5a30-91cf-5a32d6330c30_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj0/11965685beb54a38b91c3152e07ccdb8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-07',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X2 SDRIVE 18D BUSINESS X FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988858%27 HTTP/1.1" 200 None
2026-03-27 16:38:08 [ayvens.it] INFO: Saving data for 1988858: {'created_time': 1774629488.601187, 'last_price_update_time': 1774629488.601204, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988858') HTTP/1.1" 204 0
2026-03-27 16:38:08 [ayvens.it] INFO: Found listing with ID: 1984755
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984755%27 HTTP/1.1" 200 None
2026-03-27 16:38:08 [ayvens.it] INFO: Scrape type for 1984755: 2
2026-03-27 16:38:08 [ayvens.it] INFO: Extracting data for car ID: 1984755
2026-03-27 16:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 350a38c8-cd73-53ee-ae00-0c09e481e760 with identifier: 1984755
2026-03-27 16:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350a38c8-cd73-53ee-ae00-0c09e481e760 with scrape type 2
2026-03-27 16:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 350a38c8-cd73-53ee-ae00-0c09e481e760 with scrape type 2
2026-03-27 16:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 350a38c8-cd73-53ee-ae00-0c09e481e760, identifier: 1984755
2026-03-27 16:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 350a38c8-cd73-53ee-ae00-0c09e481e760 with identifier: 1984755
2026-03-27 16:38:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 350a38c8-cd73-53ee-ae00-0c09e481e760 with identifier: 1984755
2026-03-27 16:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 350a38c8-cd73-53ee-ae00-0c09e481e760 with identifier: 1984755 to the API
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO DUCATO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '350a38c8-cd73-53ee-ae00-0c09e481e760',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO MAXI 35 XLH3 2.3 Multijet 130CV 6M Furgone 4-door',
'odometer': 231243,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO MAXI 35 XLH3 2.3 Multijet 130CV 6M Furgone 4-door '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984755%27 HTTP/1.1" 200 None
2026-03-27 16:38:08 [ayvens.it] INFO: Saving data for 1984755: {'auction_closing_time': 1774859400.0, 'created_time': 1774542807.138402, 'last_price_update_time': 1774629488.979083}
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984755') HTTP/1.1" 204 0
2026-03-27 16:38:09 [ayvens.it] INFO: Found listing with ID: 1984756
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984756%27 HTTP/1.1" 200 None
2026-03-27 16:38:09 [ayvens.it] INFO: Scrape type for 1984756: 2
2026-03-27 16:38:09 [ayvens.it] INFO: Extracting data for car ID: 1984756
2026-03-27 16:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 479d940c-ad4d-52b0-8624-1a171b10e3ab with identifier: 1984756
2026-03-27 16:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 479d940c-ad4d-52b0-8624-1a171b10e3ab with scrape type 2
2026-03-27 16:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 479d940c-ad4d-52b0-8624-1a171b10e3ab with scrape type 2
2026-03-27 16:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 479d940c-ad4d-52b0-8624-1a171b10e3ab, identifier: 1984756
2026-03-27 16:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 479d940c-ad4d-52b0-8624-1a171b10e3ab with identifier: 1984756
2026-03-27 16:38:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 479d940c-ad4d-52b0-8624-1a171b10e3ab with identifier: 1984756
2026-03-27 16:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 479d940c-ad4d-52b0-8624-1a171b10e3ab with identifier: 1984756 to the API
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO PASSIONE PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '479d940c-ad4d-52b0-8624-1a171b10e3ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 1.0 70cv Ibrido Hatchback 3-door',
'odometer': 16801,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 1.0 70cv Ibrido Hatchback 3-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984756%27 HTTP/1.1" 200 None
2026-03-27 16:38:09 [ayvens.it] INFO: Saving data for 1984756: {'auction_closing_time': 1774859400.0, 'created_time': 1774542803.880211, 'last_price_update_time': 1774629489.337929}
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984756') HTTP/1.1" 204 0
2026-03-27 16:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:09 [ayvens.it] INFO: Found listing with ID: 1984757
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984757%27 HTTP/1.1" 200 None
2026-03-27 16:38:09 [ayvens.it] INFO: Scrape type for 1984757: 2
2026-03-27 16:38:09 [ayvens.it] INFO: Extracting data for car ID: 1984757
2026-03-27 16:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d29849-e8f1-57f7-9ddb-3ea4617a575c with identifier: 1984757
2026-03-27 16:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d29849-e8f1-57f7-9ddb-3ea4617a575c with scrape type 2
2026-03-27 16:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d29849-e8f1-57f7-9ddb-3ea4617a575c with scrape type 2
2026-03-27 16:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e5d29849-e8f1-57f7-9ddb-3ea4617a575c, identifier: 1984757
2026-03-27 16:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e5d29849-e8f1-57f7-9ddb-3ea4617a575c with identifier: 1984757
2026-03-27 16:38:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e5d29849-e8f1-57f7-9ddb-3ea4617a575c with identifier: 1984757
2026-03-27 16:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e5d29849-e8f1-57f7-9ddb-3ea4617a575c with identifier: 1984757 to the API
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU IMPERIALE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'e5d29849-e8f1-57f7-9ddb-3ea4617a575c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS DS 7 BLUEHDI 130 AUTOMATICA PERFORMANCE LINE+ FP',
'odometer': 94301,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS DS 7 BLUEHDI 130 AUTOMATICA PERFORMANCE LINE+ FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984757%27 HTTP/1.1" 200 None
2026-03-27 16:38:09 [ayvens.it] INFO: Saving data for 1984757: {'auction_closing_time': 1774859400.0, 'created_time': 1774542805.359014, 'last_price_update_time': 1774629489.71492}
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984757') HTTP/1.1" 204 0
2026-03-27 16:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:09 [ayvens.it] INFO: Found listing with ID: 1984758
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984758%27 HTTP/1.1" 200 None
2026-03-27 16:38:09 [ayvens.it] INFO: Scrape type for 1984758: 2
2026-03-27 16:38:09 [ayvens.it] INFO: Extracting data for car ID: 1984758
2026-03-27 16:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with identifier: 1984758
2026-03-27 16:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with scrape type 2
2026-03-27 16:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with scrape type 2
2026-03-27 16:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43, identifier: 1984758
2026-03-27 16:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with identifier: 1984758
2026-03-27 16:38:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with identifier: 1984758
2026-03-27 16:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9ec2a24d-9f86-5910-be5e-bf0fd7214d43 with identifier: 1984758 to the API
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ORANGE FUSION METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '9ec2a24d-9f86-5910-be5e-bf0fd7214d43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'KIA SPORTAGE 1.6 CRDI MHEV BUSINESS 2WD DCT',
'odometer': 37264,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'KIA KIA SPORTAGE 1.6 CRDI MHEV BUSINESS 2WD DCT -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984758%27 HTTP/1.1" 200 None
2026-03-27 16:38:10 [ayvens.it] INFO: Saving data for 1984758: {'auction_closing_time': 1774859400.0, 'created_time': 1774542790.352022, 'last_price_update_time': 1774629490.07661}
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984758') HTTP/1.1" 204 0
2026-03-27 16:38:10 [ayvens.it] INFO: Found listing with ID: 1984759
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984759%27 HTTP/1.1" 200 None
2026-03-27 16:38:10 [ayvens.it] INFO: Scrape type for 1984759: 2
2026-03-27 16:38:10 [ayvens.it] INFO: Extracting data for car ID: 1984759
2026-03-27 16:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9116223-92ed-5755-800e-77651fbd5167 with identifier: 1984759
2026-03-27 16:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9116223-92ed-5755-800e-77651fbd5167 with scrape type 2
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9116223-92ed-5755-800e-77651fbd5167 with scrape type 2
2026-03-27 16:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f9116223-92ed-5755-800e-77651fbd5167, identifier: 1984759
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6ade6f10>
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh8%252F1103159a1954417e8df37969615e8144%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/7.jpg saved to cache
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f730eb4-842c-5988-bf25-8255e3ff6545
2026-03-27 16:38:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f730eb4-842c-5988-bf25-8255e3ff6545, skipping ID generation
2026-03-27 16:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f730eb4-842c-5988-bf25-8255e3ff6545 with scrape type 1
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f730eb4-842c-5988-bf25-8255e3ff6545 sending to next pipeline
2026-03-27 16:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5f730eb4-842c-5988-bf25-8255e3ff6545, identifier: 1988857
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c57490>
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/8.jpg saved to cache
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d45e90>
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/7.jpg saved to cache
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c78b10>
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/10.jpg saved to cache
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d37590>
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/6.jpg saved to cache
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68541650>
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/8.jpg saved to cache
2026-03-27 16:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f9116223-92ed-5755-800e-77651fbd5167 with identifier: 1984759
2026-03-27 16:38:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f9116223-92ed-5755-800e-77651fbd5167 with identifier: 1984759
2026-03-27 16:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f9116223-92ed-5755-800e-77651fbd5167 with identifier: 1984759 to the API
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'VULKAN GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'f9116223-92ed-5755-800e-77651fbd5167',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL ASTRA 1.5 TURBO 130CV ELEGANCE AT8',
'odometer': 161849,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL ASTRA 1.5 TURBO 130CV ELEGANCE AT8 -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984759%27 HTTP/1.1" 200 None
2026-03-27 16:38:11 [ayvens.it] INFO: Saving data for 1984759: {'auction_closing_time': 1774859400.0, 'created_time': 1774542785.738385, 'last_price_update_time': 1774629491.088836}
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984759') HTTP/1.1" 204 0
2026-03-27 16:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5f730eb4-842c-5988-bf25-8255e3ff6545 with identifier: 1988857
2026-03-27 16:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5f730eb4-842c-5988-bf25-8255e3ff6545 with identifier: 1988857
2026-03-27 16:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5f730eb4-842c-5988-bf25-8255e3ff6545 with identifier: 1988857 to the API
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SUPER RED',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '5f730eb4-842c-5988-bf25-8255e3ff6545',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP',
'odometer': 146538,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538862,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 790720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 875929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 834182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609015,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f730eb4-842c-5988-bf25-8255e3ff6545/5f730eb4-842c-5988-bf25-8255e3ff6545_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh8/1103159a1954417e8df37969615e8144/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988857%27 HTTP/1.1" 200 None
2026-03-27 16:38:11 [ayvens.it] INFO: Saving data for 1988857: {'created_time': 1774629491.450932, 'last_price_update_time': 1774629491.450944, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988857') HTTP/1.1" 204 0
2026-03-27 16:38:11 [ayvens.it] INFO: Found listing with ID: 1984760
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984760%27 HTTP/1.1" 200 None
2026-03-27 16:38:11 [ayvens.it] INFO: Scrape type for 1984760: 2
2026-03-27 16:38:11 [ayvens.it] INFO: Extracting data for car ID: 1984760
2026-03-27 16:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c96f4f-14e0-545a-8ccb-200d75595f8b with identifier: 1984760
2026-03-27 16:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c96f4f-14e0-545a-8ccb-200d75595f8b with scrape type 2
2026-03-27 16:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44c96f4f-14e0-545a-8ccb-200d75595f8b with scrape type 2
2026-03-27 16:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 44c96f4f-14e0-545a-8ccb-200d75595f8b, identifier: 1984760
2026-03-27 16:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 44c96f4f-14e0-545a-8ccb-200d75595f8b with identifier: 1984760
2026-03-27 16:38:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 44c96f4f-14e0-545a-8ccb-200d75595f8b with identifier: 1984760
2026-03-27 16:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 44c96f4f-14e0-545a-8ccb-200d75595f8b with identifier: 1984760 to the API
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Platinum Grey metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '44c96f4f-14e0-545a-8ccb-200d75595f8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROËN C3 AIRCROSS BlueHDi 110 S&S Feel',
'odometer': 196860,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROËN C3 AIRCROSS BlueHDi 110 S&S Feel -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984760%27 HTTP/1.1" 200 None
2026-03-27 16:38:11 [ayvens.it] INFO: Saving data for 1984760: {'auction_closing_time': 1774859400.0, 'created_time': 1774542775.379412, 'last_price_update_time': 1774629491.918622}
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984760') HTTP/1.1" 204 0
2026-03-27 16:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68f1c250>
2026-03-27 16:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh1%252F34e202543fb5434ba348ecabf34fafc9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/9.jpg saved to cache
2026-03-27 16:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f
2026-03-27 16:38:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d383a6f-92e1-55bc-aa7a-a539013dba2f, skipping ID generation
2026-03-27 16:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f with scrape type 1
2026-03-27 16:38:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d383a6f-92e1-55bc-aa7a-a539013dba2f sending to next pipeline
2026-03-27 16:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6d383a6f-92e1-55bc-aa7a-a539013dba2f, identifier: 1988856
2026-03-27 16:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68606050>
2026-03-27 16:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/9.jpg saved to cache
2026-03-27 16:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:38:12 [ayvens.it] INFO: Found listing with ID: 1984761
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984761%27 HTTP/1.1" 200 None
2026-03-27 16:38:12 [ayvens.it] INFO: Scrape type for 1984761: 2
2026-03-27 16:38:12 [ayvens.it] INFO: Extracting data for car ID: 1984761
2026-03-27 16:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9af0077c-0d0f-5613-8972-4f3b8ffe8bd6 with identifier: 1984761
2026-03-27 16:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9af0077c-0d0f-5613-8972-4f3b8ffe8bd6 with scrape type 2
2026-03-27 16:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9af0077c-0d0f-5613-8972-4f3b8ffe8bd6 with scrape type 2
2026-03-27 16:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9af0077c-0d0f-5613-8972-4f3b8ffe8bd6, identifier: 1984761
2026-03-27 16:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6d383a6f-92e1-55bc-aa7a-a539013dba2f with identifier: 1988856
2026-03-27 16:38:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6d383a6f-92e1-55bc-aa7a-a539013dba2f with identifier: 1988856
2026-03-27 16:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6d383a6f-92e1-55bc-aa7a-a539013dba2f with identifier: 1988856 to the API
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero brillante',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '6d383a6f-92e1-55bc-aa7a-a539013dba2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 40 TDI Busin. Advanced quattro S tronic Sport utility '
'vehicle 5-door (Euro 6D) mild hybrid',
'odometer': 98965,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626539,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d383a6f-92e1-55bc-aa7a-a539013dba2f/6d383a6f-92e1-55bc-aa7a-a539013dba2f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584419,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh1/34e202543fb5434ba348ecabf34fafc9/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-11',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 40 TDI Busin. Advanced quattro S tronic Sport utility '
'vehicle 5-door (Euro 6D) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988856%27 HTTP/1.1" 200 None
2026-03-27 16:38:12 [ayvens.it] INFO: Saving data for 1988856: {'created_time': 1774629492.743863, 'last_price_update_time': 1774629492.743873, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988856') HTTP/1.1" 204 0
2026-03-27 16:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9af0077c-0d0f-5613-8972-4f3b8ffe8bd6 with identifier: 1984761
2026-03-27 16:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9af0077c-0d0f-5613-8972-4f3b8ffe8bd6 with identifier: 1984761
2026-03-27 16:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9af0077c-0d0f-5613-8972-4f3b8ffe8bd6 with identifier: 1984761 to the API
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'THUNDER GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '9af0077c-0d0f-5613-8972-4f3b8ffe8bd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO PLUS BRIGHT FP',
'odometer': 39790,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-13',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO PLUS BRIGHT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984761%27 HTTP/1.1" 200 None
2026-03-27 16:38:13 [ayvens.it] INFO: Saving data for 1984761: {'auction_closing_time': 1774859400.0, 'created_time': 1774542772.168469, 'last_price_update_time': 1774629493.004223}
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984761') HTTP/1.1" 204 0
2026-03-27 16:38:13 [ayvens.it] INFO: Found listing with ID: 1984762
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984762%27 HTTP/1.1" 200 None
2026-03-27 16:38:13 [ayvens.it] INFO: Scrape type for 1984762: 2
2026-03-27 16:38:13 [ayvens.it] INFO: Extracting data for car ID: 1984762
2026-03-27 16:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91e82bd-af96-5406-9298-53beb696a674 with identifier: 1984762
2026-03-27 16:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91e82bd-af96-5406-9298-53beb696a674 with scrape type 2
2026-03-27 16:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a91e82bd-af96-5406-9298-53beb696a674 with scrape type 2
2026-03-27 16:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a91e82bd-af96-5406-9298-53beb696a674, identifier: 1984762
2026-03-27 16:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a91e82bd-af96-5406-9298-53beb696a674 with identifier: 1984762
2026-03-27 16:38:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a91e82bd-af96-5406-9298-53beb696a674 with identifier: 1984762
2026-03-27 16:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a91e82bd-af96-5406-9298-53beb696a674 with identifier: 1984762 to the API
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'electric',
'id': 'a91e82bd-af96-5406-9298-53beb696a674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD MUSTANG MACH-E 269CV Standard Range Sport utility vehicle '
'5-door',
'odometer': 31034,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD MUSTANG MACH-E 269CV Standard Range Sport utility vehicle '
'5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984762%27 HTTP/1.1" 200 None
2026-03-27 16:38:13 [ayvens.it] INFO: Saving data for 1984762: {'auction_closing_time': 1774859400.0, 'created_time': 1774542774.112293, 'last_price_update_time': 1774629493.356135}
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984762') HTTP/1.1" 204 0
2026-03-27 16:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:13 [ayvens.it] INFO: Found listing with ID: 1984763
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984763%27 HTTP/1.1" 200 None
2026-03-27 16:38:13 [ayvens.it] INFO: Scrape type for 1984763: 2
2026-03-27 16:38:13 [ayvens.it] INFO: Extracting data for car ID: 1984763
2026-03-27 16:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f91a4fc-b10d-5fd3-b71f-834d9036c6a6 with identifier: 1984763
2026-03-27 16:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f91a4fc-b10d-5fd3-b71f-834d9036c6a6 with scrape type 2
2026-03-27 16:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f91a4fc-b10d-5fd3-b71f-834d9036c6a6 with scrape type 2
2026-03-27 16:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1f91a4fc-b10d-5fd3-b71f-834d9036c6a6, identifier: 1984763
2026-03-27 16:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1f91a4fc-b10d-5fd3-b71f-834d9036c6a6 with identifier: 1984763
2026-03-27 16:38:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1f91a4fc-b10d-5fd3-b71f-834d9036c6a6 with identifier: 1984763
2026-03-27 16:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1f91a4fc-b10d-5fd3-b71f-834d9036c6a6 with identifier: 1984763 to the API
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO ETOILE MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '1f91a4fc-b10d-5fd3-b71f-834d9036c6a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT CAPTUR 1.3 TCE MHEV 103KW TECHNO',
'odometer': 47686,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT CAPTUR 1.3 TCE MHEV 103KW TECHNO -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984763%27 HTTP/1.1" 200 None
2026-03-27 16:38:13 [ayvens.it] INFO: Saving data for 1984763: {'auction_closing_time': 1774859400.0, 'created_time': 1774542775.769609, 'last_price_update_time': 1774629493.702738}
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984763') HTTP/1.1" 204 0
2026-03-27 16:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:13 [ayvens.it] INFO: Found listing with ID: 1984764
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984764%27 HTTP/1.1" 200 None
2026-03-27 16:38:13 [ayvens.it] INFO: Scrape type for 1984764: 2
2026-03-27 16:38:13 [ayvens.it] INFO: Extracting data for car ID: 1984764
2026-03-27 16:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97c18bbb-21d9-5a99-8dac-e9a1648d70d3 with identifier: 1984764
2026-03-27 16:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c18bbb-21d9-5a99-8dac-e9a1648d70d3 with scrape type 2
2026-03-27 16:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97c18bbb-21d9-5a99-8dac-e9a1648d70d3 with scrape type 2
2026-03-27 16:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 97c18bbb-21d9-5a99-8dac-e9a1648d70d3, identifier: 1984764
2026-03-27 16:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922f0d0>
2026-03-27 16:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/7.jpg saved to cache
2026-03-27 16:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 97c18bbb-21d9-5a99-8dac-e9a1648d70d3 with identifier: 1984764
2026-03-27 16:38:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 97c18bbb-21d9-5a99-8dac-e9a1648d70d3 with identifier: 1984764
2026-03-27 16:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 97c18bbb-21d9-5a99-8dac-e9a1648d70d3 with identifier: 1984764 to the API
2026-03-27 16:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'PLATINUM SILVER METALLIZZATO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '97c18bbb-21d9-5a99-8dac-e9a1648d70d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL VIVARO 1.6 BiT. 145cv S&S Eco L2H1 29 qli Sport Combi 4-door',
'odometer': 205452,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-24',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL VIVARO 1.6 BiT. 145cv S&S Eco L2H1 29 qli Sport Combi '
'4-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984764%27 HTTP/1.1" 200 None
2026-03-27 16:38:14 [ayvens.it] INFO: Saving data for 1984764: {'auction_closing_time': 1774859400.0, 'created_time': 1774542777.633379, 'last_price_update_time': 1774629494.113669}
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984764') HTTP/1.1" 204 0
2026-03-27 16:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:14 [ayvens.it] INFO: Found listing with ID: 1984765
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984765%27 HTTP/1.1" 200 None
2026-03-27 16:38:14 [ayvens.it] INFO: Scrape type for 1984765: 2
2026-03-27 16:38:14 [ayvens.it] INFO: Extracting data for car ID: 1984765
2026-03-27 16:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e3c4192-bb6c-508c-ae5b-d4c399166c0d with identifier: 1984765
2026-03-27 16:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e3c4192-bb6c-508c-ae5b-d4c399166c0d with scrape type 2
2026-03-27 16:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e3c4192-bb6c-508c-ae5b-d4c399166c0d with scrape type 2
2026-03-27 16:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2e3c4192-bb6c-508c-ae5b-d4c399166c0d, identifier: 1984765
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691c8e50>
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/5.jpg saved to cache
2026-03-27 16:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922e710>
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/8.jpg saved to cache
2026-03-27 16:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2e3c4192-bb6c-508c-ae5b-d4c399166c0d with identifier: 1984765
2026-03-27 16:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2e3c4192-bb6c-508c-ae5b-d4c399166c0d with identifier: 1984765
2026-03-27 16:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2e3c4192-bb6c-508c-ae5b-d4c399166c0d with identifier: 1984765 to the API
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blu Navarra metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '2e3c4192-bb6c-508c-ae5b-d4c399166c0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 35 TDI S tronic Business S.Back Hatchback 5-door (Euro 6D)',
'odometer': 70324,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 35 TDI S tronic Business S.Back Hatchback 5-door (Euro '
'6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984765%27 HTTP/1.1" 200 None
2026-03-27 16:38:14 [ayvens.it] INFO: Saving data for 1984765: {'auction_closing_time': 1774859400.0, 'created_time': 1774542791.856655, 'last_price_update_time': 1774629494.766419}
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984765') HTTP/1.1" 204 0
2026-03-27 16:38:14 [ayvens.it] INFO: Found listing with ID: 1984766
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984766%27 HTTP/1.1" 200 None
2026-03-27 16:38:14 [ayvens.it] INFO: Scrape type for 1984766: 2
2026-03-27 16:38:14 [ayvens.it] INFO: Extracting data for car ID: 1984766
2026-03-27 16:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b00991aa-52cb-53eb-b010-4355a3054f1d with identifier: 1984766
2026-03-27 16:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b00991aa-52cb-53eb-b010-4355a3054f1d with scrape type 2
2026-03-27 16:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b00991aa-52cb-53eb-b010-4355a3054f1d with scrape type 2
2026-03-27 16:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b00991aa-52cb-53eb-b010-4355a3054f1d, identifier: 1984766
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68542110>
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fb51eb0889ec64f60a9029b5ba5dcb7f6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/6.jpg saved to cache
2026-03-27 16:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d50ee168-81db-55af-9d97-40f36811d509
2026-03-27 16:38:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d50ee168-81db-55af-9d97-40f36811d509, skipping ID generation
2026-03-27 16:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d50ee168-81db-55af-9d97-40f36811d509 with scrape type 1
2026-03-27 16:38:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d50ee168-81db-55af-9d97-40f36811d509 sending to next pipeline
2026-03-27 16:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d50ee168-81db-55af-9d97-40f36811d509, identifier: 1988854
2026-03-27 16:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912e290>
2026-03-27 16:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252F42398918e2e54ac695e32dcc13c70c1c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/6.jpg saved to cache
2026-03-27 16:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099
2026-03-27 16:38:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099, skipping ID generation
2026-03-27 16:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099 with scrape type 1
2026-03-27 16:38:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099 sending to next pipeline
2026-03-27 16:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099, identifier: 1988852
2026-03-27 16:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6912dad0>
2026-03-27 16:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg3%252F449958bde148483396cda1f94dca77b3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/9.jpg saved to cache
2026-03-27 16:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97276624-8541-564d-ac98-0ddc817904ac
2026-03-27 16:38:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97276624-8541-564d-ac98-0ddc817904ac, skipping ID generation
2026-03-27 16:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97276624-8541-564d-ac98-0ddc817904ac with scrape type 1
2026-03-27 16:38:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97276624-8541-564d-ac98-0ddc817904ac sending to next pipeline
2026-03-27 16:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 97276624-8541-564d-ac98-0ddc817904ac, identifier: 1988850
2026-03-27 16:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b00991aa-52cb-53eb-b010-4355a3054f1d with identifier: 1984766
2026-03-27 16:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b00991aa-52cb-53eb-b010-4355a3054f1d with identifier: 1984766
2026-03-27 16:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b00991aa-52cb-53eb-b010-4355a3054f1d with identifier: 1984766 to the API
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'b00991aa-52cb-53eb-b010-4355a3054f1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO 2.2 BLUEHDI 140 S&S 33 L2H2 FP',
'odometer': 115153,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-20',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO 2.2 BLUEHDI 140 S&S 33 L2H2 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984766%27 HTTP/1.1" 200 None
2026-03-27 16:38:15 [ayvens.it] INFO: Saving data for 1984766: {'auction_closing_time': 1774859400.0, 'created_time': 1774542800.72451, 'last_price_update_time': 1774629495.704881}
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984766') HTTP/1.1" 204 0
2026-03-27 16:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d50ee168-81db-55af-9d97-40f36811d509 with identifier: 1988854
2026-03-27 16:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d50ee168-81db-55af-9d97-40f36811d509 with identifier: 1988854
2026-03-27 16:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d50ee168-81db-55af-9d97-40f36811d509 with identifier: 1988854 to the API
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ARTICO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'd50ee168-81db-55af-9d97-40f36811d509',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES SPRINTER 311 CDI F39/33 T.ALTO P.M. TR.ANT. FP',
'odometer': 116050,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578801,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625367,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50ee168-81db-55af-9d97-40f36811d509/d50ee168-81db-55af-9d97-40f36811d509_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/b51eb0889ec64f60a9029b5ba5dcb7f6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES SPRINTER 311 CDI F39/33 T.ALTO P.M. TR.ANT. '
'FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988854%27 HTTP/1.1" 200 None
2026-03-27 16:38:16 [ayvens.it] INFO: Saving data for 1988854: {'created_time': 1774629496.090589, 'last_price_update_time': 1774629496.090601, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988854') HTTP/1.1" 204 0
2026-03-27 16:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099 with identifier: 1988852
2026-03-27 16:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099 with identifier: 1988852
2026-03-27 16:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099 with identifier: 1988852 to the API
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ARTICO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES SPRINTER 311 CDI F39/33 T.ALTO P.M. TR.ANT. FP',
'odometer': 65694,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643218,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643218,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588443,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 612988,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541911,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541911,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596559,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099/b4bdc870-dd05-52e6-bbcd-c5fe7a4f6099_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/42398918e2e54ac695e32dcc13c70c1c/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES SPRINTER 311 CDI F39/33 T.ALTO P.M. TR.ANT. '
'FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988852%27 HTTP/1.1" 200 None
2026-03-27 16:38:16 [ayvens.it] INFO: Saving data for 1988852: {'created_time': 1774629496.477872, 'last_price_update_time': 1774629496.477883, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988852') HTTP/1.1" 204 0
2026-03-27 16:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 97276624-8541-564d-ac98-0ddc817904ac with identifier: 1988850
2026-03-27 16:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 97276624-8541-564d-ac98-0ddc817904ac with identifier: 1988850
2026-03-27 16:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 97276624-8541-564d-ac98-0ddc817904ac with identifier: 1988850 to the API
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Black metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '97276624-8541-564d-ac98-0ddc817904ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN JUKE 1.0 DIG-T 114 N-Connecta Mt Cross over 5-door (Euro 6D)',
'odometer': 56191,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671302,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 787156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588964,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594008,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97276624-8541-564d-ac98-0ddc817904ac/97276624-8541-564d-ac98-0ddc817904ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg3/449958bde148483396cda1f94dca77b3/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN JUKE 1.0 DIG-T 114 N-Connecta Mt Cross over 5-door '
'(Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988850%27 HTTP/1.1" 200 None
2026-03-27 16:38:16 [ayvens.it] INFO: Saving data for 1988850: {'created_time': 1774629496.870948, 'last_price_update_time': 1774629496.870959, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988850') HTTP/1.1" 204 0
2026-03-27 16:38:16 [ayvens.it] INFO: Found listing with ID: 1984767
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984767%27 HTTP/1.1" 200 None
2026-03-27 16:38:16 [ayvens.it] INFO: Scrape type for 1984767: 2
2026-03-27 16:38:16 [ayvens.it] INFO: Extracting data for car ID: 1984767
2026-03-27 16:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4de6aeec-05c1-50a6-84b4-dad448e9004f with identifier: 1984767
2026-03-27 16:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4de6aeec-05c1-50a6-84b4-dad448e9004f with scrape type 2
2026-03-27 16:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4de6aeec-05c1-50a6-84b4-dad448e9004f with scrape type 2
2026-03-27 16:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4de6aeec-05c1-50a6-84b4-dad448e9004f, identifier: 1984767
2026-03-27 16:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4de6aeec-05c1-50a6-84b4-dad448e9004f with identifier: 1984767
2026-03-27 16:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4de6aeec-05c1-50a6-84b4-dad448e9004f with identifier: 1984767
2026-03-27 16:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4de6aeec-05c1-50a6-84b4-dad448e9004f with identifier: 1984767 to the API
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'LONDON GREY MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '4de6aeec-05c1-50a6-84b4-dad448e9004f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW (PC) TS HYBRID BUSINESS FP',
'odometer': 203096,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW (PC) TS HYBRID BUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984767%27 HTTP/1.1" 200 None
2026-03-27 16:38:17 [ayvens.it] INFO: Saving data for 1984767: {'auction_closing_time': 1774859400.0, 'created_time': 1774542796.556153, 'last_price_update_time': 1774629497.231084}
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984767') HTTP/1.1" 204 0
2026-03-27 16:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69409250>
2026-03-27 16:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/6.jpg saved to cache
2026-03-27 16:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e692de7d0>
2026-03-27 16:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg9%252Fbc3428d2f71b4f2ba41fdedf0bc55fca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/7.jpg saved to cache
2026-03-27 16:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80
2026-03-27 16:38:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80, skipping ID generation
2026-03-27 16:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80 with scrape type 1
2026-03-27 16:38:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80 sending to next pipeline
2026-03-27 16:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80, identifier: 1988853
2026-03-27 16:38:17 [ayvens.it] INFO: Found listing with ID: 1984768
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984768%27 HTTP/1.1" 200 None
2026-03-27 16:38:17 [ayvens.it] INFO: Scrape type for 1984768: 2
2026-03-27 16:38:17 [ayvens.it] INFO: Extracting data for car ID: 1984768
2026-03-27 16:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02a616a5-7abb-56c9-bae8-b50d0acc3858 with identifier: 1984768
2026-03-27 16:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a616a5-7abb-56c9-bae8-b50d0acc3858 with scrape type 2
2026-03-27 16:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02a616a5-7abb-56c9-bae8-b50d0acc3858 with scrape type 2
2026-03-27 16:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 02a616a5-7abb-56c9-bae8-b50d0acc3858, identifier: 1984768
2026-03-27 16:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80 with identifier: 1988853
2026-03-27 16:38:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80 with identifier: 1988853
2026-03-27 16:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80 with identifier: 1988853 to the API
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU IRON METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': '3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT CLIO 1.0 TCE 66KW BUSINESS FP',
'odometer': 164594,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 47,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 909693,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 916821,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 909693,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 914966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 928326,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829353,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 815163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80/3d7bb7cd-2e74-5999-bfe4-8a00c1f3dc80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776875,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg9/bc3428d2f71b4f2ba41fdedf0bc55fca/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-08',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT CLIO 1.0 TCE 66KW BUSINESS FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988853%27 HTTP/1.1" 200 None
2026-03-27 16:38:18 [ayvens.it] INFO: Saving data for 1988853: {'created_time': 1774629498.055614, 'last_price_update_time': 1774629498.055626, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988853') HTTP/1.1" 204 0
2026-03-27 16:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 02a616a5-7abb-56c9-bae8-b50d0acc3858 with identifier: 1984768
2026-03-27 16:38:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 02a616a5-7abb-56c9-bae8-b50d0acc3858 with identifier: 1984768
2026-03-27 16:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 02a616a5-7abb-56c9-bae8-b50d0acc3858 with identifier: 1984768 to the API
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO PASSION METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'electric',
'id': '02a616a5-7abb-56c9-bae8-b50d0acc3858',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT ZOE (PC) ZOE ZEN R110 FP',
'odometer': 81612,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT ZOE (PC) ZOE ZEN R110 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984768%27 HTTP/1.1" 200 None
2026-03-27 16:38:18 [ayvens.it] INFO: Saving data for 1984768: {'auction_closing_time': 1774859400.0, 'created_time': 1774542798.47742, 'last_price_update_time': 1774629498.340668}
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984768') HTTP/1.1" 204 0
2026-03-27 16:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:18 [ayvens.it] INFO: Found listing with ID: 1984769
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984769%27 HTTP/1.1" 200 None
2026-03-27 16:38:18 [ayvens.it] INFO: Scrape type for 1984769: 2
2026-03-27 16:38:18 [ayvens.it] INFO: Extracting data for car ID: 1984769
2026-03-27 16:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fe04712-bcad-590e-bb2b-860a7cff1cbe with identifier: 1984769
2026-03-27 16:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe04712-bcad-590e-bb2b-860a7cff1cbe with scrape type 2
2026-03-27 16:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fe04712-bcad-590e-bb2b-860a7cff1cbe with scrape type 2
2026-03-27 16:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4fe04712-bcad-590e-bb2b-860a7cff1cbe, identifier: 1984769
2026-03-27 16:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4fe04712-bcad-590e-bb2b-860a7cff1cbe with identifier: 1984769
2026-03-27 16:38:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4fe04712-bcad-590e-bb2b-860a7cff1cbe with identifier: 1984769
2026-03-27 16:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4fe04712-bcad-590e-bb2b-860a7cff1cbe with identifier: 1984769 to the API
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE PEARL BRILLIANT',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '4fe04712-bcad-590e-bb2b-860a7cff1cbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI 1.3 MHEV 158 Business Xtronic Cross over 5-door '
'(Euro 6D)',
'odometer': 79593,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI 1.3 MHEV 158 Business Xtronic Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984769%27 HTTP/1.1" 200 None
2026-03-27 16:38:18 [ayvens.it] INFO: Saving data for 1984769: {'auction_closing_time': 1774859400.0, 'created_time': 1774542802.955852, 'last_price_update_time': 1774629498.684508}
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984769') HTTP/1.1" 204 0
2026-03-27 16:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:18 [ayvens.it] INFO: Found listing with ID: 1984770
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984770%27 HTTP/1.1" 200 None
2026-03-27 16:38:18 [ayvens.it] INFO: Scrape type for 1984770: 2
2026-03-27 16:38:18 [ayvens.it] INFO: Extracting data for car ID: 1984770
2026-03-27 16:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e095ee81-4918-5e44-bff0-ba8aee20fd19 with identifier: 1984770
2026-03-27 16:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e095ee81-4918-5e44-bff0-ba8aee20fd19 with scrape type 2
2026-03-27 16:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e095ee81-4918-5e44-bff0-ba8aee20fd19 with scrape type 2
2026-03-27 16:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e095ee81-4918-5e44-bff0-ba8aee20fd19, identifier: 1984770
2026-03-27 16:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6b1ab9d0>
2026-03-27 16:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/4.jpg saved to cache
2026-03-27 16:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e095ee81-4918-5e44-bff0-ba8aee20fd19 with identifier: 1984770
2026-03-27 16:38:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e095ee81-4918-5e44-bff0-ba8aee20fd19 with identifier: 1984770
2026-03-27 16:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e095ee81-4918-5e44-bff0-ba8aee20fd19 with identifier: 1984770 to the API
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO GRAFITE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'e095ee81-4918-5e44-bff0-ba8aee20fd19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LEXUS',
'model': 'LEXUS NX HYBRID F SPORT 4WD MY22 FP',
'odometer': 170540,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'LEXUS LEXUS NX HYBRID F SPORT 4WD MY22 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984770%27 HTTP/1.1" 200 None
2026-03-27 16:38:19 [ayvens.it] INFO: Saving data for 1984770: {'auction_closing_time': 1774859400.0, 'created_time': 1774542808.948313, 'last_price_update_time': 1774629499.256607}
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984770') HTTP/1.1" 204 0
2026-03-27 16:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:19 [ayvens.it] INFO: Found listing with ID: 1984771
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984771%27 HTTP/1.1" 200 None
2026-03-27 16:38:19 [ayvens.it] INFO: Scrape type for 1984771: 2
2026-03-27 16:38:19 [ayvens.it] INFO: Extracting data for car ID: 1984771
2026-03-27 16:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 066a2162-a6f3-5622-8230-f93463606622 with identifier: 1984771
2026-03-27 16:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 066a2162-a6f3-5622-8230-f93463606622 with scrape type 2
2026-03-27 16:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 066a2162-a6f3-5622-8230-f93463606622 with scrape type 2
2026-03-27 16:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 066a2162-a6f3-5622-8230-f93463606622, identifier: 1984771
2026-03-27 16:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69517c90>
2026-03-27 16:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge8%252Fab6f1365e60a4d5abab252a357887a49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/1.jpg saved to cache
2026-03-27 16:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ca892a8-1055-5334-bc2d-3429b13ba531
2026-03-27 16:38:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ca892a8-1055-5334-bc2d-3429b13ba531, skipping ID generation
2026-03-27 16:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca892a8-1055-5334-bc2d-3429b13ba531 with scrape type 1
2026-03-27 16:38:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ca892a8-1055-5334-bc2d-3429b13ba531 sending to next pipeline
2026-03-27 16:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5ca892a8-1055-5334-bc2d-3429b13ba531, identifier: 1988848
2026-03-27 16:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 066a2162-a6f3-5622-8230-f93463606622 with identifier: 1984771
2026-03-27 16:38:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 066a2162-a6f3-5622-8230-f93463606622 with identifier: 1984771
2026-03-27 16:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 066a2162-a6f3-5622-8230-f93463606622 with identifier: 1984771 to the API
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GUN METALLIC METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'electric',
'id': '066a2162-a6f3-5622-8230-f93463606622',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN ARIYA 87kWh Evolve 2WD Cross over 5-door',
'odometer': 47625,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN ARIYA 87kWh Evolve 2WD Cross over 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984771%27 HTTP/1.1" 200 None
2026-03-27 16:38:19 [ayvens.it] INFO: Saving data for 1984771: {'auction_closing_time': 1774859400.0, 'created_time': 1774542810.512396, 'last_price_update_time': 1774629499.786123}
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984771') HTTP/1.1" 204 0
2026-03-27 16:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5ca892a8-1055-5334-bc2d-3429b13ba531 with identifier: 1988848
2026-03-27 16:38:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5ca892a8-1055-5334-bc2d-3429b13ba531 with identifier: 1988848
2026-03-27 16:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5ca892a8-1055-5334-bc2d-3429b13ba531 with identifier: 1988848 to the API
2026-03-27 16:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DIFFUSED SILVER',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '5ca892a8-1055-5334-bc2d-3429b13ba531',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD GRAND TOURNEO C 1.5 TDCI 120 CV 7 POSTI TITANIUM AUTO FP',
'odometer': 49810,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457855,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca892a8-1055-5334-bc2d-3429b13ba531/5ca892a8-1055-5334-bc2d-3429b13ba531_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge8/ab6f1365e60a4d5abab252a357887a49/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD GRAND TOURNEO C 1.5 TDCI 120 CV 7 POSTI TITANIUM AUTO FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988848%27 HTTP/1.1" 200 None
2026-03-27 16:38:20 [ayvens.it] INFO: Saving data for 1988848: {'created_time': 1774629500.285529, 'last_price_update_time': 1774629500.285539, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988848') HTTP/1.1" 204 0
2026-03-27 16:38:20 [ayvens.it] INFO: Found listing with ID: 1984772
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984772%27 HTTP/1.1" 200 None
2026-03-27 16:38:20 [ayvens.it] INFO: Scrape type for 1984772: 2
2026-03-27 16:38:20 [ayvens.it] INFO: Extracting data for car ID: 1984772
2026-03-27 16:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7e734b2-21e0-570a-ad1a-e03b50ebd128 with identifier: 1984772
2026-03-27 16:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7e734b2-21e0-570a-ad1a-e03b50ebd128 with scrape type 2
2026-03-27 16:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7e734b2-21e0-570a-ad1a-e03b50ebd128 with scrape type 2
2026-03-27 16:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d7e734b2-21e0-570a-ad1a-e03b50ebd128, identifier: 1984772
2026-03-27 16:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d7e734b2-21e0-570a-ad1a-e03b50ebd128 with identifier: 1984772
2026-03-27 16:38:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d7e734b2-21e0-570a-ad1a-e03b50ebd128 with identifier: 1984772
2026-03-27 16:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d7e734b2-21e0-570a-ad1a-e03b50ebd128 with identifier: 1984772 to the API
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO HIGH',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'd7e734b2-21e0-570a-ad1a-e03b50ebd128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES-BENZ GLC COUPÈ 220 d 4Matic Premium aut. Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 191550,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES-BENZ GLC COUPÈ 220 d 4Matic Premium aut. '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984772%27 HTTP/1.1" 200 None
2026-03-27 16:38:20 [ayvens.it] INFO: Saving data for 1984772: {'auction_closing_time': 1774859400.0, 'created_time': 1774542816.567656, 'last_price_update_time': 1774629500.657043}
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984772') HTTP/1.1" 204 0
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68482a90>
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/9.jpg saved to cache
2026-03-27 16:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69070490>
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Ff5802c46f02641ceacacec6d6d38d415%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/8.jpg saved to cache
2026-03-27 16:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2d71540-f2b4-55fd-9496-439d6a40639e
2026-03-27 16:38:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2d71540-f2b4-55fd-9496-439d6a40639e, skipping ID generation
2026-03-27 16:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d71540-f2b4-55fd-9496-439d6a40639e with scrape type 1
2026-03-27 16:38:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2d71540-f2b4-55fd-9496-439d6a40639e sending to next pipeline
2026-03-27 16:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e2d71540-f2b4-55fd-9496-439d6a40639e, identifier: 1988846
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69280510>
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/10.jpg saved to cache
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69071b90>
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/9.jpg saved to cache
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cfa790>
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg0%252Fc1faec3e30e341bba4b0bc94b6c6a7ad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/8.jpg saved to cache
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61c78b58-c522-5146-9c1f-eccf733ce454
2026-03-27 16:38:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61c78b58-c522-5146-9c1f-eccf733ce454, skipping ID generation
2026-03-27 16:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61c78b58-c522-5146-9c1f-eccf733ce454 with scrape type 1
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61c78b58-c522-5146-9c1f-eccf733ce454 sending to next pipeline
2026-03-27 16:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 61c78b58-c522-5146-9c1f-eccf733ce454, identifier: 1988847
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69162e10>
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg8%252Fcf305c31aeb046a79ee8f7455afd4701%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/4.jpg saved to cache
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e34e4a9-718b-5484-b363-748022835342
2026-03-27 16:38:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e34e4a9-718b-5484-b363-748022835342, skipping ID generation
2026-03-27 16:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e34e4a9-718b-5484-b363-748022835342 with scrape type 1
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e34e4a9-718b-5484-b363-748022835342 sending to next pipeline
2026-03-27 16:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0e34e4a9-718b-5484-b363-748022835342, identifier: 1988836
2026-03-27 16:38:21 [ayvens.it] INFO: Found listing with ID: 1984773
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984773%27 HTTP/1.1" 200 None
2026-03-27 16:38:21 [ayvens.it] INFO: Scrape type for 1984773: 2
2026-03-27 16:38:21 [ayvens.it] INFO: Extracting data for car ID: 1984773
2026-03-27 16:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0352839d-be8a-578d-997c-458592f42191 with identifier: 1984773
2026-03-27 16:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0352839d-be8a-578d-997c-458592f42191 with scrape type 2
2026-03-27 16:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0352839d-be8a-578d-997c-458592f42191 with scrape type 2
2026-03-27 16:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0352839d-be8a-578d-997c-458592f42191, identifier: 1984773
2026-03-27 16:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e2d71540-f2b4-55fd-9496-439d6a40639e with identifier: 1988846
2026-03-27 16:38:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e2d71540-f2b4-55fd-9496-439d6a40639e with identifier: 1988846
2026-03-27 16:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e2d71540-f2b4-55fd-9496-439d6a40639e with identifier: 1988846 to the API
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Polar White',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'petrol',
'id': 'e2d71540-f2b4-55fd-9496-439d6a40639e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROËN C3 PureTech 83 S&S Feel Pack Neo patentati Hatchback 5-door '
'(Euro 6D)',
'odometer': 63551,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805181,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 818359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805181,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 779894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 617222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650443,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d71540-f2b4-55fd-9496-439d6a40639e/e2d71540-f2b4-55fd-9496-439d6a40639e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/f5802c46f02641ceacacec6d6d38d415/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROËN C3 PureTech 83 S&S Feel Pack Neo patentati '
'Hatchback 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988846%27 HTTP/1.1" 200 None
2026-03-27 16:38:22 [ayvens.it] INFO: Saving data for 1988846: {'created_time': 1774629502.016974, 'last_price_update_time': 1774629502.016984, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988846') HTTP/1.1" 204 0
2026-03-27 16:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 61c78b58-c522-5146-9c1f-eccf733ce454 with identifier: 1988847
2026-03-27 16:38:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 61c78b58-c522-5146-9c1f-eccf733ce454 with identifier: 1988847
2026-03-27 16:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 61c78b58-c522-5146-9c1f-eccf733ce454 with identifier: 1988847 to the API
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Misano Blue metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '61c78b58-c522-5146-9c1f-eccf733ce454',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X2 xDrive 25e M Sport automatico Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 38013,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 55,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 775192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 812172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 775192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 947189,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 872591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 760246,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648194,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61c78b58-c522-5146-9c1f-eccf733ce454/61c78b58-c522-5146-9c1f-eccf733ce454_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg0/c1faec3e30e341bba4b0bc94b6c6a7ad/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X2 xDrive 25e M Sport automatico Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988847%27 HTTP/1.1" 200 None
2026-03-27 16:38:22 [ayvens.it] INFO: Saving data for 1988847: {'created_time': 1774629502.523802, 'last_price_update_time': 1774629502.523813, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988847') HTTP/1.1" 204 0
2026-03-27 16:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0e34e4a9-718b-5484-b363-748022835342 with identifier: 1988836
2026-03-27 16:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0e34e4a9-718b-5484-b363-748022835342 with identifier: 1988836
2026-03-27 16:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0e34e4a9-718b-5484-b363-748022835342 with identifier: 1988836 to the API
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'POLAR WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '0e34e4a9-718b-5484-b363-748022835342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN C3 (PC) BLUEHDI 100 S&S BUSINESS COMBI FP',
'odometer': 144745,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482615,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526576,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482615,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e34e4a9-718b-5484-b363-748022835342/0e34e4a9-718b-5484-b363-748022835342_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg8/cf305c31aeb046a79ee8f7455afd4701/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN C3 (PC) BLUEHDI 100 S&S BUSINESS COMBI FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988836%27 HTTP/1.1" 200 None
2026-03-27 16:38:22 [ayvens.it] INFO: Saving data for 1988836: {'created_time': 1774629502.871121, 'last_price_update_time': 1774629502.871132, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988836') HTTP/1.1" 204 0
2026-03-27 16:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0352839d-be8a-578d-997c-458592f42191 with identifier: 1984773
2026-03-27 16:38:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0352839d-be8a-578d-997c-458592f42191 with identifier: 1984773
2026-03-27 16:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0352839d-be8a-578d-997c-458592f42191 with identifier: 1984773 to the API
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO SCISTO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '0352839d-be8a-578d-997c-458592f42191',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT CLIO 1.0 TCE 66KW EQUILIBRE Hatchback 5-door (Euro 6D)',
'odometer': 94926,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT CLIO 1.0 TCE 66KW EQUILIBRE Hatchback 5-door (Euro '
'6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984773%27 HTTP/1.1" 200 None
2026-03-27 16:38:23 [ayvens.it] INFO: Saving data for 1984773: {'auction_closing_time': 1774859400.0, 'created_time': 1774542812.508634, 'last_price_update_time': 1774629503.245035}
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984773') HTTP/1.1" 204 0
2026-03-27 16:38:23 [ayvens.it] INFO: Found listing with ID: 1984774
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984774%27 HTTP/1.1" 200 None
2026-03-27 16:38:23 [ayvens.it] INFO: Scrape type for 1984774: 2
2026-03-27 16:38:23 [ayvens.it] INFO: Extracting data for car ID: 1984774
2026-03-27 16:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c6629f2-5567-5fa3-833c-a78096254fef with identifier: 1984774
2026-03-27 16:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c6629f2-5567-5fa3-833c-a78096254fef with scrape type 2
2026-03-27 16:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c6629f2-5567-5fa3-833c-a78096254fef with scrape type 2
2026-03-27 16:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6c6629f2-5567-5fa3-833c-a78096254fef, identifier: 1984774
2026-03-27 16:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6c6629f2-5567-5fa3-833c-a78096254fef with identifier: 1984774
2026-03-27 16:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6c6629f2-5567-5fa3-833c-a78096254fef with identifier: 1984774
2026-03-27 16:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6c6629f2-5567-5fa3-833c-a78096254fef with identifier: 1984774 to the API
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO GRAPHITE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '6c6629f2-5567-5fa3-833c-a78096254fef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA KAMIQ 1.0 TSI 81KW STYLE DSG Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 43332,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA KAMIQ 1.0 TSI 81KW STYLE DSG Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984774%27 HTTP/1.1" 200 None
2026-03-27 16:38:23 [ayvens.it] INFO: Saving data for 1984774: {'auction_closing_time': 1774859400.0, 'created_time': 1774542815.245005, 'last_price_update_time': 1774629503.591066}
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984774') HTTP/1.1" 204 0
2026-03-27 16:38:23 [ayvens.it] INFO: Found listing with ID: 1984775
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984775%27 HTTP/1.1" 200 None
2026-03-27 16:38:23 [ayvens.it] INFO: Scrape type for 1984775: 2
2026-03-27 16:38:23 [ayvens.it] INFO: Extracting data for car ID: 1984775
2026-03-27 16:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69093e7b-cdeb-5921-8e0c-dfd6e3f96b2c with identifier: 1984775
2026-03-27 16:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69093e7b-cdeb-5921-8e0c-dfd6e3f96b2c with scrape type 2
2026-03-27 16:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69093e7b-cdeb-5921-8e0c-dfd6e3f96b2c with scrape type 2
2026-03-27 16:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 69093e7b-cdeb-5921-8e0c-dfd6e3f96b2c, identifier: 1984775
2026-03-27 16:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 69093e7b-cdeb-5921-8e0c-dfd6e3f96b2c with identifier: 1984775
2026-03-27 16:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 69093e7b-cdeb-5921-8e0c-dfd6e3f96b2c with identifier: 1984775
2026-03-27 16:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 69093e7b-cdeb-5921-8e0c-dfd6e3f96b2c with identifier: 1984775 to the API
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '69093e7b-cdeb-5921-8e0c-dfd6e3f96b2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DUCATO 35 MH1 2.0 Mjet 16V 115CV ALU Dop.Cab. Cassone a sponde '
'abbattibili doppia cabina 4-door',
'odometer': 142657,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DUCATO 35 MH1 2.0 Mjet 16V 115CV ALU Dop.Cab. Cassone a '
'sponde abbattibili doppia cabina 4-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984775%27 HTTP/1.1" 200 None
2026-03-27 16:38:23 [ayvens.it] INFO: Saving data for 1984775: {'auction_closing_time': 1774859400.0, 'created_time': 1774542818.045385, 'last_price_update_time': 1774629503.963841}
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984775') HTTP/1.1" 204 0
2026-03-27 16:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:23 [ayvens.it] INFO: Found listing with ID: 1984776
2026-03-27 16:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984776%27 HTTP/1.1" 200 None
2026-03-27 16:38:24 [ayvens.it] INFO: Scrape type for 1984776: 2
2026-03-27 16:38:24 [ayvens.it] INFO: Extracting data for car ID: 1984776
2026-03-27 16:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 369b264d-ed09-5696-980d-9d8e1c951414 with identifier: 1984776
2026-03-27 16:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369b264d-ed09-5696-980d-9d8e1c951414 with scrape type 2
2026-03-27 16:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 369b264d-ed09-5696-980d-9d8e1c951414 with scrape type 2
2026-03-27 16:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 369b264d-ed09-5696-980d-9d8e1c951414, identifier: 1984776
2026-03-27 16:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 369b264d-ed09-5696-980d-9d8e1c951414 with identifier: 1984776
2026-03-27 16:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 369b264d-ed09-5696-980d-9d8e1c951414 with identifier: 1984776
2026-03-27 16:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 369b264d-ed09-5696-980d-9d8e1c951414 with identifier: 1984776 to the API
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MYTHOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '369b264d-ed09-5696-980d-9d8e1c951414',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 40 TDI Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D) mild hybrid',
'odometer': 87927,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 40 TDI Business quattro S tronic Sport utility vehicle '
'5-door (Euro 6D) mild hybrid -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984776%27 HTTP/1.1" 200 None
2026-03-27 16:38:24 [ayvens.it] INFO: Saving data for 1984776: {'auction_closing_time': 1774859400.0, 'created_time': 1774542819.232986, 'last_price_update_time': 1774629504.336812}
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984776') HTTP/1.1" 204 0
2026-03-27 16:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:24 [ayvens.it] INFO: Found listing with ID: 1984777
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984777%27 HTTP/1.1" 200 None
2026-03-27 16:38:24 [ayvens.it] INFO: Scrape type for 1984777: 2
2026-03-27 16:38:24 [ayvens.it] INFO: Extracting data for car ID: 1984777
2026-03-27 16:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1615da-5a09-5550-a05a-9b75485b46f9 with identifier: 1984777
2026-03-27 16:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1615da-5a09-5550-a05a-9b75485b46f9 with scrape type 2
2026-03-27 16:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a1615da-5a09-5550-a05a-9b75485b46f9 with scrape type 2
2026-03-27 16:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9a1615da-5a09-5550-a05a-9b75485b46f9, identifier: 1984777
2026-03-27 16:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9a1615da-5a09-5550-a05a-9b75485b46f9 with identifier: 1984777
2026-03-27 16:38:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9a1615da-5a09-5550-a05a-9b75485b46f9 with identifier: 1984777
2026-03-27 16:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9a1615da-5a09-5550-a05a-9b75485b46f9 with identifier: 1984777 to the API
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DEEP CRYSTAL BLUE MICALIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '9a1615da-5a09-5550-a05a-9b75485b46f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MAZDA',
'model': 'MAZDA CX-30 2.0L Skyactiv-X 186cv M Hybrid Exclusive Sport utility '
'vehicle 5-door (Euro 6D) mild hybrid',
'odometer': 101458,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'MAZDA MAZDA CX-30 2.0L Skyactiv-X 186cv M Hybrid Exclusive Sport '
'utility vehicle 5-door (Euro 6D) mild hybrid -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984777%27 HTTP/1.1" 200 None
2026-03-27 16:38:24 [ayvens.it] INFO: Saving data for 1984777: {'auction_closing_time': 1774859400.0, 'created_time': 1774542821.395476, 'last_price_update_time': 1774629504.707244}
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984777') HTTP/1.1" 204 0
2026-03-27 16:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d22850>
2026-03-27 16:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/5.jpg saved to cache
2026-03-27 16:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:24 [ayvens.it] INFO: Found listing with ID: 1984778
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984778%27 HTTP/1.1" 200 None
2026-03-27 16:38:24 [ayvens.it] INFO: Scrape type for 1984778: 2
2026-03-27 16:38:24 [ayvens.it] INFO: Extracting data for car ID: 1984778
2026-03-27 16:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52cdae72-d376-5224-8d2f-5e0c702385b3 with identifier: 1984778
2026-03-27 16:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52cdae72-d376-5224-8d2f-5e0c702385b3 with scrape type 2
2026-03-27 16:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52cdae72-d376-5224-8d2f-5e0c702385b3 with scrape type 2
2026-03-27 16:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 52cdae72-d376-5224-8d2f-5e0c702385b3, identifier: 1984778
2026-03-27 16:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 52cdae72-d376-5224-8d2f-5e0c702385b3 with identifier: 1984778
2026-03-27 16:38:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 52cdae72-d376-5224-8d2f-5e0c702385b3 with identifier: 1984778
2026-03-27 16:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 52cdae72-d376-5224-8d2f-5e0c702385b3 with identifier: 1984778 to the API
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Portofino Blue metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '52cdae72-d376-5224-8d2f-5e0c702385b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER VELAR 2.0 D I4 204 SE 4WD Auto Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 87583,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-01',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER VELAR 2.0 D I4 204 SE 4WD Auto '
'Sport utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984778%27 HTTP/1.1" 200 None
2026-03-27 16:38:25 [ayvens.it] INFO: Saving data for 1984778: {'auction_closing_time': 1774859400.0, 'created_time': 1774542823.511746, 'last_price_update_time': 1774629505.432435}
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984778') HTTP/1.1" 204 0
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684e5410>
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/4.jpg saved to cache
2026-03-27 16:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68ca3450>
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/5.jpg saved to cache
2026-03-27 16:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d47210>
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/3.jpg saved to cache
2026-03-27 16:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:38:25 [ayvens.it] INFO: Found listing with ID: 1984779
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984779%27 HTTP/1.1" 200 None
2026-03-27 16:38:25 [ayvens.it] INFO: Scrape type for 1984779: 2
2026-03-27 16:38:25 [ayvens.it] INFO: Extracting data for car ID: 1984779
2026-03-27 16:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd76b57c-f569-581b-a2ce-beeaec6a270b with identifier: 1984779
2026-03-27 16:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd76b57c-f569-581b-a2ce-beeaec6a270b with scrape type 2
2026-03-27 16:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd76b57c-f569-581b-a2ce-beeaec6a270b with scrape type 2
2026-03-27 16:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dd76b57c-f569-581b-a2ce-beeaec6a270b, identifier: 1984779
2026-03-27 16:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dd76b57c-f569-581b-a2ce-beeaec6a270b with identifier: 1984779
2026-03-27 16:38:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dd76b57c-f569-581b-a2ce-beeaec6a270b with identifier: 1984779
2026-03-27 16:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dd76b57c-f569-581b-a2ce-beeaec6a270b with identifier: 1984779 to the API
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'dd76b57c-f569-581b-a2ce-beeaec6a270b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 85211,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-11',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA 2.5 Benzina FHEV 190CV 2WD ST-Line X Aut Sport '
'utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984779%27 HTTP/1.1" 200 None
2026-03-27 16:38:26 [ayvens.it] INFO: Saving data for 1984779: {'auction_closing_time': 1774859400.0, 'created_time': 1774542825.85903, 'last_price_update_time': 1774629506.188603}
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984779') HTTP/1.1" 204 0
2026-03-27 16:38:26 [ayvens.it] INFO: Found listing with ID: 1984780
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984780%27 HTTP/1.1" 200 None
2026-03-27 16:38:26 [ayvens.it] INFO: Scrape type for 1984780: 2
2026-03-27 16:38:26 [ayvens.it] INFO: Extracting data for car ID: 1984780
2026-03-27 16:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4d69182-7a5c-59ec-8858-77380a1a4c90 with identifier: 1984780
2026-03-27 16:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4d69182-7a5c-59ec-8858-77380a1a4c90 with scrape type 2
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4d69182-7a5c-59ec-8858-77380a1a4c90 with scrape type 2
2026-03-27 16:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f4d69182-7a5c-59ec-8858-77380a1a4c90, identifier: 1984780
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b20e50>
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl5%252F50dc6e927c0543b1a8e61cbb56d67339%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/4.jpg saved to cache
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2288d3f2-666e-5e45-8549-1b8e0466441e
2026-03-27 16:38:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2288d3f2-666e-5e45-8549-1b8e0466441e, skipping ID generation
2026-03-27 16:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2288d3f2-666e-5e45-8549-1b8e0466441e with scrape type 1
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2288d3f2-666e-5e45-8549-1b8e0466441e sending to next pipeline
2026-03-27 16:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2288d3f2-666e-5e45-8549-1b8e0466441e, identifier: 1988833
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d34150>
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp5%252Fc86b245525f44b878fe9248aa20d63d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/3.jpg saved to cache
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed
2026-03-27 16:38:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed, skipping ID generation
2026-03-27 16:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed with scrape type 1
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed sending to next pipeline
2026-03-27 16:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed, identifier: 1988834
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68d34e90>
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/5.jpg saved to cache
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69457f50>
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/4.jpg saved to cache
2026-03-27 16:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f4d69182-7a5c-59ec-8858-77380a1a4c90 with identifier: 1984780
2026-03-27 16:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f4d69182-7a5c-59ec-8858-77380a1a4c90 with identifier: 1984780
2026-03-27 16:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f4d69182-7a5c-59ec-8858-77380a1a4c90 with identifier: 1984780 to the API
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'f4d69182-7a5c-59ec-8858-77380a1a4c90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLÃ’ CARGO CH1 BUSINESS 1.6 Mjet 105cv E6D-f S&S Vettura '
'Furgonata 4-door (Euro 6D)',
'odometer': 162416,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLÃ’ CARGO CH1 BUSINESS 1.6 Mjet 105cv E6D-f S&S Vettura '
'Furgonata 4-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984780%27 HTTP/1.1" 200 None
2026-03-27 16:38:27 [ayvens.it] INFO: Saving data for 1984780: {'auction_closing_time': 1774859400.0, 'created_time': 1774542827.501257, 'last_price_update_time': 1774629507.241682}
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984780') HTTP/1.1" 204 0
2026-03-27 16:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2288d3f2-666e-5e45-8549-1b8e0466441e with identifier: 1988833
2026-03-27 16:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2288d3f2-666e-5e45-8549-1b8e0466441e with identifier: 1988833
2026-03-27 16:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2288d3f2-666e-5e45-8549-1b8e0466441e with identifier: 1988833 to the API
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '2288d3f2-666e-5e45-8549-1b8e0466441e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS 1.5 Ecoblue 120cv Business Auto SW SW 5-door (Euro 6.2)',
'odometer': 74659,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667281,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 713328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 741092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513642,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2288d3f2-666e-5e45-8549-1b8e0466441e/2288d3f2-666e-5e45-8549-1b8e0466441e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577798,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl5/50dc6e927c0543b1a8e61cbb56d67339/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS 1.5 Ecoblue 120cv Business Auto SW SW 5-door (Euro '
'6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988833%27 HTTP/1.1" 200 None
2026-03-27 16:38:27 [ayvens.it] INFO: Saving data for 1988833: {'created_time': 1774629507.621278, 'last_price_update_time': 1774629507.621289, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988833') HTTP/1.1" 204 0
2026-03-27 16:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed with identifier: 1988834
2026-03-27 16:38:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed with identifier: 1988834
2026-03-27 16:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed with identifier: 1988834 to the API
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CYBER ORANGE',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'electric',
'id': '8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD MUSTANG MACH-E 269CV Standard Range',
'odometer': 37339,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 896659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 896659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 880545,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 612147,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed/8b742c6d-2ad1-5f5c-bb86-5e4b227a70ed_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542590,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp5/c86b245525f44b878fe9248aa20d63d0/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD MUSTANG MACH-E 269CV Standard Range -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988834%27 HTTP/1.1" 200 None
2026-03-27 16:38:27 [ayvens.it] INFO: Saving data for 1988834: {'created_time': 1774629507.985391, 'last_price_update_time': 1774629507.985401, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988834') HTTP/1.1" 204 0
2026-03-27 16:38:28 [ayvens.it] INFO: Found listing with ID: 1984781
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984781%27 HTTP/1.1" 200 None
2026-03-27 16:38:28 [ayvens.it] INFO: Scrape type for 1984781: 2
2026-03-27 16:38:28 [ayvens.it] INFO: Extracting data for car ID: 1984781
2026-03-27 16:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with identifier: 1984781
2026-03-27 16:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with scrape type 2
2026-03-27 16:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with scrape type 2
2026-03-27 16:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0def6868-7bd9-530c-8e54-f07a5d61e0d7, identifier: 1984781
2026-03-27 16:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with identifier: 1984781
2026-03-27 16:38:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with identifier: 1984781
2026-03-27 16:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0def6868-7bd9-530c-8e54-f07a5d61e0d7 with identifier: 1984781 to the API
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU SEPANG EFFETTO PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '0def6868-7bd9-530c-8e54-f07a5d61e0d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 SPORTBACK 45 TFSI S LINE QUATTRO S TRONIC FP',
'odometer': 32755,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-26',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 SPORTBACK 45 TFSI S LINE QUATTRO S TRONIC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984781%27 HTTP/1.1" 200 None
2026-03-27 16:38:28 [ayvens.it] INFO: Saving data for 1984781: {'auction_closing_time': 1774859400.0, 'created_time': 1774542934.677289, 'last_price_update_time': 1774629508.393368}
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984781') HTTP/1.1" 204 0
2026-03-27 16:38:28 [ayvens.it] INFO: Found listing with ID: 1984782
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984782%27 HTTP/1.1" 200 None
2026-03-27 16:38:28 [ayvens.it] INFO: Scrape type for 1984782: 2
2026-03-27 16:38:28 [ayvens.it] INFO: Extracting data for car ID: 1984782
2026-03-27 16:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with identifier: 1984782
2026-03-27 16:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with scrape type 2
2026-03-27 16:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with scrape type 2
2026-03-27 16:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a, identifier: 1984782
2026-03-27 16:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with identifier: 1984782
2026-03-27 16:38:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with identifier: 1984782
2026-03-27 16:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9c8babdf-a91e-5dc7-a32f-a39678b13e8a with identifier: 1984782 to the API
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CARPATHIAN GREY METALLIZZATO PREMIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '9c8babdf-a91e-5dc7-a32f-a39678b13e8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 150CV R-DYNAMIC S 4WD AUT. FP',
'odometer': 110289,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-06',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER DISCOVERY SPORT 2.0 TD4 150CV R-DYNAMIC S 4WD '
'AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984782%27 HTTP/1.1" 200 None
2026-03-27 16:38:28 [ayvens.it] INFO: Saving data for 1984782: {'auction_closing_time': 1774859400.0, 'created_time': 1774542830.984547, 'last_price_update_time': 1774629508.804854}
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984782') HTTP/1.1" 204 0
2026-03-27 16:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:28 [ayvens.it] INFO: Found listing with ID: 1984783
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984783%27 HTTP/1.1" 200 None
2026-03-27 16:38:28 [ayvens.it] INFO: Scrape type for 1984783: 2
2026-03-27 16:38:28 [ayvens.it] INFO: Extracting data for car ID: 1984783
2026-03-27 16:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f8f8b5b-a257-5001-9698-620edb753611 with identifier: 1984783
2026-03-27 16:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f8f8b5b-a257-5001-9698-620edb753611 with scrape type 2
2026-03-27 16:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f8f8b5b-a257-5001-9698-620edb753611 with scrape type 2
2026-03-27 16:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4f8f8b5b-a257-5001-9698-620edb753611, identifier: 1984783
2026-03-27 16:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4f8f8b5b-a257-5001-9698-620edb753611 with identifier: 1984783
2026-03-27 16:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4f8f8b5b-a257-5001-9698-620edb753611 with identifier: 1984783
2026-03-27 16:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4f8f8b5b-a257-5001-9698-620edb753611 with identifier: 1984783 to the API
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SANTORINI BLACK MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '4f8f8b5b-a257-5001-9698-620edb753611',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LAND ROVER',
'model': 'LAND ROVER RANGE ROVER EVO 2.0D I4 204 MHEV DYNAMIC SE AWD AUTO FP',
'odometer': 31919,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'LAND ROVER LAND ROVER RANGE ROVER EVO 2.0D I4 204 MHEV DYNAMIC SE '
'AWD AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984783%27 HTTP/1.1" 200 None
2026-03-27 16:38:29 [ayvens.it] INFO: Saving data for 1984783: {'auction_closing_time': 1774859400.0, 'created_time': 1774542933.226159, 'last_price_update_time': 1774629509.239266}
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984783') HTTP/1.1" 204 0
2026-03-27 16:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:29 [ayvens.it] INFO: Found listing with ID: 1984784
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984784%27 HTTP/1.1" 200 None
2026-03-27 16:38:29 [ayvens.it] INFO: Scrape type for 1984784: 2
2026-03-27 16:38:29 [ayvens.it] INFO: Extracting data for car ID: 1984784
2026-03-27 16:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3abea8f0-8acd-52f6-bc60-f84db4aa841d with identifier: 1984784
2026-03-27 16:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3abea8f0-8acd-52f6-bc60-f84db4aa841d with scrape type 2
2026-03-27 16:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3abea8f0-8acd-52f6-bc60-f84db4aa841d with scrape type 2
2026-03-27 16:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3abea8f0-8acd-52f6-bc60-f84db4aa841d, identifier: 1984784
2026-03-27 16:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3abea8f0-8acd-52f6-bc60-f84db4aa841d with identifier: 1984784
2026-03-27 16:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3abea8f0-8acd-52f6-bc60-f84db4aa841d with identifier: 1984784
2026-03-27 16:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3abea8f0-8acd-52f6-bc60-f84db4aa841d with identifier: 1984784 to the API
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ONYX BLACK METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '3abea8f0-8acd-52f6-bc60-f84db4aa841d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 T4 Recharge Plug-in auto Plus Bright Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 162465,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 T4 Recharge Plug-in auto Plus Bright Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984784%27 HTTP/1.1" 200 None
2026-03-27 16:38:29 [ayvens.it] INFO: Saving data for 1984784: {'auction_closing_time': 1774859400.0, 'created_time': 1774542924.986082, 'last_price_update_time': 1774629509.599111}
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984784') HTTP/1.1" 204 0
2026-03-27 16:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e684fb9d0>
2026-03-27 16:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm6%252F32b8fa2fa83f4448926f364e2a6816fb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/3.jpg saved to cache
2026-03-27 16:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3db0ae23-83f2-56ed-926c-c96feecde9d4
2026-03-27 16:38:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3db0ae23-83f2-56ed-926c-c96feecde9d4, skipping ID generation
2026-03-27 16:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db0ae23-83f2-56ed-926c-c96feecde9d4 with scrape type 1
2026-03-27 16:38:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3db0ae23-83f2-56ed-926c-c96feecde9d4 sending to next pipeline
2026-03-27 16:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3db0ae23-83f2-56ed-926c-c96feecde9d4, identifier: 1988831
2026-03-27 16:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:29 [ayvens.it] INFO: Found listing with ID: 1984785
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984785%27 HTTP/1.1" 200 None
2026-03-27 16:38:29 [ayvens.it] INFO: Scrape type for 1984785: 2
2026-03-27 16:38:29 [ayvens.it] INFO: Extracting data for car ID: 1984785
2026-03-27 16:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd022ccb-e494-576e-b98e-e2f143823363 with identifier: 1984785
2026-03-27 16:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd022ccb-e494-576e-b98e-e2f143823363 with scrape type 2
2026-03-27 16:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd022ccb-e494-576e-b98e-e2f143823363 with scrape type 2
2026-03-27 16:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cd022ccb-e494-576e-b98e-e2f143823363, identifier: 1984785
2026-03-27 16:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3db0ae23-83f2-56ed-926c-c96feecde9d4 with identifier: 1988831
2026-03-27 16:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3db0ae23-83f2-56ed-926c-c96feecde9d4 with identifier: 1988831
2026-03-27 16:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3db0ae23-83f2-56ed-926c-c96feecde9d4 with identifier: 1988831 to the API
2026-03-27 16:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '3db0ae23-83f2-56ed-926c-c96feecde9d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP',
'odometer': 106670,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511769,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539281,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3db0ae23-83f2-56ed-926c-c96feecde9d4/3db0ae23-83f2-56ed-926c-c96feecde9d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm6/32b8fa2fa83f4448926f364e2a6816fb/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 5008 (PC) BLUEHDI 130 ALLURE EAT8 S/S AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988831%27 HTTP/1.1" 200 None
2026-03-27 16:38:30 [ayvens.it] INFO: Saving data for 1988831: {'created_time': 1774629510.324457, 'last_price_update_time': 1774629510.324467, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988831') HTTP/1.1" 204 0
2026-03-27 16:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cd022ccb-e494-576e-b98e-e2f143823363 with identifier: 1984785
2026-03-27 16:38:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cd022ccb-e494-576e-b98e-e2f143823363 with identifier: 1984785
2026-03-27 16:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cd022ccb-e494-576e-b98e-e2f143823363 with identifier: 1984785 to the API
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU NAVARA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'cd022ccb-e494-576e-b98e-e2f143823363',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A4 SW 2.0 40 TDI QUAT. SLINE EDIT. S TRONIC',
'odometer': 77868,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A4 SW 2.0 40 TDI QUAT. SLINE EDIT. S TRONIC -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984785%27 HTTP/1.1" 200 None
2026-03-27 16:38:30 [ayvens.it] INFO: Saving data for 1984785: {'auction_closing_time': 1774859400.0, 'created_time': 1774542920.724906, 'last_price_update_time': 1774629510.666539}
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984785') HTTP/1.1" 204 0
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6add4690>
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm7%252Fa08052dea46144b0919b88991c4a6f27%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/3.jpg saved to cache
2026-03-27 16:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773
2026-03-27 16:38:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44ebe2bd-3d94-51c2-9bed-b612bff4f773, skipping ID generation
2026-03-27 16:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773 with scrape type 1
2026-03-27 16:38:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44ebe2bd-3d94-51c2-9bed-b612bff4f773 sending to next pipeline
2026-03-27 16:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 44ebe2bd-3d94-51c2-9bed-b612bff4f773, identifier: 1988832
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68c79fd0>
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/7.jpg saved to cache
2026-03-27 16:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68609dd0>
2026-03-27 16:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm5%252F3e442d43550b4c48bcab2acbf73373d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/6.jpg saved to cache
2026-03-27 16:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53
2026-03-27 16:38:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53, skipping ID generation
2026-03-27 16:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53 with scrape type 1
2026-03-27 16:38:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53 sending to next pipeline
2026-03-27 16:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53, identifier: 1988830
2026-03-27 16:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68533a90>
2026-03-27 16:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/6.jpg saved to cache
2026-03-27 16:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:38:31 [ayvens.it] INFO: Found listing with ID: 1984786
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984786%27 HTTP/1.1" 200 None
2026-03-27 16:38:31 [ayvens.it] INFO: Scrape type for 1984786: 2
2026-03-27 16:38:31 [ayvens.it] INFO: Extracting data for car ID: 1984786
2026-03-27 16:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5667603b-949a-5274-84ce-b5d3e241fdc2 with identifier: 1984786
2026-03-27 16:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5667603b-949a-5274-84ce-b5d3e241fdc2 with scrape type 2
2026-03-27 16:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5667603b-949a-5274-84ce-b5d3e241fdc2 with scrape type 2
2026-03-27 16:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5667603b-949a-5274-84ce-b5d3e241fdc2, identifier: 1984786
2026-03-27 16:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 44ebe2bd-3d94-51c2-9bed-b612bff4f773 with identifier: 1988832
2026-03-27 16:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 44ebe2bd-3d94-51c2-9bed-b612bff4f773 with identifier: 1988832
2026-03-27 16:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 44ebe2bd-3d94-51c2-9bed-b612bff4f773 with identifier: 1988832 to the API
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARGENTO BRILLANTE',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '44ebe2bd-3d94-51c2-9bed-b612bff4f773',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA SW 2.0 TDI EVO 110KW STYLE DSG 4WD FP',
'odometer': 126518,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 42,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 834104,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 808212,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 821073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636489,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689034,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ebe2bd-3d94-51c2-9bed-b612bff4f773/44ebe2bd-3d94-51c2-9bed-b612bff4f773_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591432,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm7/a08052dea46144b0919b88991c4a6f27/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-09',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA SW 2.0 TDI EVO 110KW STYLE DSG 4WD FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988832%27 HTTP/1.1" 200 None
2026-03-27 16:38:31 [ayvens.it] INFO: Saving data for 1988832: {'created_time': 1774629511.766243, 'last_price_update_time': 1774629511.766253, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988832') HTTP/1.1" 204 0
2026-03-27 16:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53 with identifier: 1988830
2026-03-27 16:38:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53 with identifier: 1988830
2026-03-27 16:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53 with identifier: 1988830 to the API
2026-03-27 16:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DOLPHIN GREY METALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP',
'odometer': 93024,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777314,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777314,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702598,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 804571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661080,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53/3ff40710-7ee3-5bbb-a37b-f3f3e3e90e53_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm5/3e442d43550b4c48bcab2acbf73373d1/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN (PC) 2.0 TDI SCR 110KW LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988830%27 HTTP/1.1" 200 None
2026-03-27 16:38:32 [ayvens.it] INFO: Saving data for 1988830: {'created_time': 1774629512.116775, 'last_price_update_time': 1774629512.116785, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988830') HTTP/1.1" 204 0
2026-03-27 16:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5667603b-949a-5274-84ce-b5d3e241fdc2 with identifier: 1984786
2026-03-27 16:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5667603b-949a-5274-84ce-b5d3e241fdc2 with identifier: 1984786
2026-03-27 16:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5667603b-949a-5274-84ce-b5d3e241fdc2 with identifier: 1984786 to the API
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO ARTENSE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '5667603b-949a-5274-84ce-b5d3e241fdc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 308 SW SW Allure BlueHDi 130 EAT8 S&S aut. SW 5-door (Euro '
'6D)',
'odometer': 92249,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 308 SW SW Allure BlueHDi 130 EAT8 S&S aut. SW '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984786%27 HTTP/1.1" 200 None
2026-03-27 16:38:32 [ayvens.it] INFO: Saving data for 1984786: {'auction_closing_time': 1774859400.0, 'created_time': 1774542917.713683, 'last_price_update_time': 1774629512.388405}
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984786') HTTP/1.1" 204 0
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69424d90>
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/9.jpg saved to cache
2026-03-27 16:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69162750>
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F3fff19cfbe6948bbaed396e3378850e8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/7.jpg saved to cache
2026-03-27 16:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac
2026-03-27 16:38:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f7235a9-b52f-5df2-b724-35ebe7dab0ac, skipping ID generation
2026-03-27 16:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac with scrape type 1
2026-03-27 16:38:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f7235a9-b52f-5df2-b724-35ebe7dab0ac sending to next pipeline
2026-03-27 16:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6f7235a9-b52f-5df2-b724-35ebe7dab0ac, identifier: 1988828
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e6922dfd0>
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm3%252F98426967651742a19ceb536f478e3ced%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/5.jpg saved to cache
2026-03-27 16:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aabde983-cd06-5582-9512-e57840d1001f
2026-03-27 16:38:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aabde983-cd06-5582-9512-e57840d1001f, skipping ID generation
2026-03-27 16:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aabde983-cd06-5582-9512-e57840d1001f with scrape type 1
2026-03-27 16:38:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aabde983-cd06-5582-9512-e57840d1001f sending to next pipeline
2026-03-27 16:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: aabde983-cd06-5582-9512-e57840d1001f, identifier: 1988829
2026-03-27 16:38:32 [ayvens.it] INFO: Found listing with ID: 1984787
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984787%27 HTTP/1.1" 200 None
2026-03-27 16:38:32 [ayvens.it] INFO: Scrape type for 1984787: 2
2026-03-27 16:38:32 [ayvens.it] INFO: Extracting data for car ID: 1984787
2026-03-27 16:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac951d4a-3e73-5724-a425-274b2b948c8d with identifier: 1984787
2026-03-27 16:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac951d4a-3e73-5724-a425-274b2b948c8d with scrape type 2
2026-03-27 16:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac951d4a-3e73-5724-a425-274b2b948c8d with scrape type 2
2026-03-27 16:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ac951d4a-3e73-5724-a425-274b2b948c8d, identifier: 1984787
2026-03-27 16:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6f7235a9-b52f-5df2-b724-35ebe7dab0ac with identifier: 1988828
2026-03-27 16:38:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6f7235a9-b52f-5df2-b724-35ebe7dab0ac with identifier: 1988828
2026-03-27 16:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6f7235a9-b52f-5df2-b724-35ebe7dab0ac with identifier: 1988828 to the API
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SILVER DAWN MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'hybrid',
'id': '6f7235a9-b52f-5df2-b724-35ebe7dab0ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO CORE FP',
'odometer': 85813,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532495,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7235a9-b52f-5df2-b724-35ebe7dab0ac/6f7235a9-b52f-5df2-b724-35ebe7dab0ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/3fff19cfbe6948bbaed396e3378850e8/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC40 (PC) T4 RECHARGE PLUG-IN AUTO CORE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988828%27 HTTP/1.1" 200 None
2026-03-27 16:38:33 [ayvens.it] INFO: Saving data for 1988828: {'created_time': 1774629513.433741, 'last_price_update_time': 1774629513.433755, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988828') HTTP/1.1" 204 0
2026-03-27 16:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: aabde983-cd06-5582-9512-e57840d1001f with identifier: 1988829
2026-03-27 16:38:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: aabde983-cd06-5582-9512-e57840d1001f with identifier: 1988829
2026-03-27 16:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: aabde983-cd06-5582-9512-e57840d1001f with identifier: 1988829 to the API
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Alpine White',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'aabde983-cd06-5582-9512-e57840d1001f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIE 1 116d Business Advantage Hatchback 5-door (Euro 6D)',
'odometer': 73801,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 68,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 761964,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 825217,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 761964,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 842835,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827487,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632914,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabde983-cd06-5582-9512-e57840d1001f/aabde983-cd06-5582-9512-e57840d1001f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm3/98426967651742a19ceb536f478e3ced/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIE 1 116d Business Advantage Hatchback 5-door (Euro 6D) '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988829%27 HTTP/1.1" 200 None
2026-03-27 16:38:33 [ayvens.it] INFO: Saving data for 1988829: {'created_time': 1774629513.798502, 'last_price_update_time': 1774629513.798512, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988829') HTTP/1.1" 204 0
2026-03-27 16:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ac951d4a-3e73-5724-a425-274b2b948c8d with identifier: 1984787
2026-03-27 16:38:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ac951d4a-3e73-5724-a425-274b2b948c8d with identifier: 1984787
2026-03-27 16:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ac951d4a-3e73-5724-a425-274b2b948c8d with identifier: 1984787 to the API
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ORYX WHITE PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'ac951d4a-3e73-5724-a425-274b2b948c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN PASSAT SW VAR. 2.0TDI SCR 147KW 4MOT EXECUTIVE DSG FP',
'odometer': 154742,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN PASSAT SW VAR. 2.0TDI SCR 147KW 4MOT '
'EXECUTIVE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984787%27 HTTP/1.1" 200 None
2026-03-27 16:38:34 [ayvens.it] INFO: Saving data for 1984787: {'auction_closing_time': 1774859400.0, 'created_time': 1774542900.935674, 'last_price_update_time': 1774629514.302397}
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984787') HTTP/1.1" 204 0
2026-03-27 16:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:34 [ayvens.it] INFO: Found listing with ID: 1984788
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984788%27 HTTP/1.1" 200 None
2026-03-27 16:38:34 [ayvens.it] INFO: Scrape type for 1984788: 2
2026-03-27 16:38:34 [ayvens.it] INFO: Extracting data for car ID: 1984788
2026-03-27 16:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065cc2a8-07b5-5761-87fc-b552e83f406c with identifier: 1984788
2026-03-27 16:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065cc2a8-07b5-5761-87fc-b552e83f406c with scrape type 2
2026-03-27 16:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 065cc2a8-07b5-5761-87fc-b552e83f406c with scrape type 2
2026-03-27 16:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 065cc2a8-07b5-5761-87fc-b552e83f406c, identifier: 1984788
2026-03-27 16:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 065cc2a8-07b5-5761-87fc-b552e83f406c with identifier: 1984788
2026-03-27 16:38:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 065cc2a8-07b5-5761-87fc-b552e83f406c with identifier: 1984788
2026-03-27 16:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 065cc2a8-07b5-5761-87fc-b552e83f406c with identifier: 1984788 to the API
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Smoky Grey Metall',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '065cc2a8-07b5-5761-87fc-b552e83f406c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TAIGO 1.0 TSI 70kW Life Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 234209,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TAIGO 1.0 TSI 70kW Life Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984788%27 HTTP/1.1" 200 None
2026-03-27 16:38:34 [ayvens.it] INFO: Saving data for 1984788: {'auction_closing_time': 1774859400.0, 'created_time': 1774542900.381355, 'last_price_update_time': 1774629514.941311}
2026-03-27 16:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984788') HTTP/1.1" 204 0
2026-03-27 16:38:35 [ayvens.it] INFO: Found listing with ID: 1984789
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984789%27 HTTP/1.1" 200 None
2026-03-27 16:38:35 [ayvens.it] INFO: Scrape type for 1984789: 2
2026-03-27 16:38:35 [ayvens.it] INFO: Extracting data for car ID: 1984789
2026-03-27 16:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d262ae-1687-5c74-9271-931b16eaa703 with identifier: 1984789
2026-03-27 16:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d262ae-1687-5c74-9271-931b16eaa703 with scrape type 2
2026-03-27 16:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6d262ae-1687-5c74-9271-931b16eaa703 with scrape type 2
2026-03-27 16:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d6d262ae-1687-5c74-9271-931b16eaa703, identifier: 1984789
2026-03-27 16:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68b5db10>
2026-03-27 16:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/8.jpg saved to cache
2026-03-27 16:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d6d262ae-1687-5c74-9271-931b16eaa703 with identifier: 1984789
2026-03-27 16:38:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d6d262ae-1687-5c74-9271-931b16eaa703 with identifier: 1984789
2026-03-27 16:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d6d262ae-1687-5c74-9271-931b16eaa703 with identifier: 1984789 to the API
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'AMAZON GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'd6d262ae-1687-5c74-9271-931b16eaa703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'HYUNDAI TUCSON 1.6 HEV 2wd 230cv Xline Auto Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 87225,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI HYUNDAI TUCSON 1.6 HEV 2wd 230cv Xline Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984789%27 HTTP/1.1" 200 None
2026-03-27 16:38:35 [ayvens.it] INFO: Saving data for 1984789: {'auction_closing_time': 1774859400.0, 'created_time': 1774542899.107055, 'last_price_update_time': 1774629515.651013}
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984789') HTTP/1.1" 204 0
2026-03-27 16:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:38:35 [ayvens.it] INFO: Found listing with ID: 1984790
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984790%27 HTTP/1.1" 200 None
2026-03-27 16:38:35 [ayvens.it] INFO: Scrape type for 1984790: 2
2026-03-27 16:38:35 [ayvens.it] INFO: Extracting data for car ID: 1984790
2026-03-27 16:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af960f69-6e1e-5806-92de-b527b7a17c9f with identifier: 1984790
2026-03-27 16:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af960f69-6e1e-5806-92de-b527b7a17c9f with scrape type 2
2026-03-27 16:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af960f69-6e1e-5806-92de-b527b7a17c9f with scrape type 2
2026-03-27 16:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af960f69-6e1e-5806-92de-b527b7a17c9f, identifier: 1984790
2026-03-27 16:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af960f69-6e1e-5806-92de-b527b7a17c9f with identifier: 1984790
2026-03-27 16:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af960f69-6e1e-5806-92de-b527b7a17c9f with identifier: 1984790
2026-03-27 16:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af960f69-6e1e-5806-92de-b527b7a17c9f with identifier: 1984790 to the API
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO PASSIONE PASTELLO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'af960f69-6e1e-5806-92de-b527b7a17c9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT 500 1.0 70cv Ibrido Hatchback 3-door',
'odometer': 19022,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT 500 1.0 70cv Ibrido Hatchback 3-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984790%27 HTTP/1.1" 200 None
2026-03-27 16:38:36 [ayvens.it] INFO: Saving data for 1984790: {'auction_closing_time': 1774859400.0, 'created_time': 1774542841.225714, 'last_price_update_time': 1774629516.015712}
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984790') HTTP/1.1" 204 0
2026-03-27 16:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e691ed9d0>
2026-03-27 16:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/7.jpg saved to cache
2026-03-27 16:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:38:36 [ayvens.it] INFO: Found listing with ID: 1984791
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984791%27 HTTP/1.1" 200 None
2026-03-27 16:38:36 [ayvens.it] INFO: Scrape type for 1984791: 2
2026-03-27 16:38:36 [ayvens.it] INFO: Extracting data for car ID: 1984791
2026-03-27 16:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac200acc-d712-5cfa-af90-7fe4a864b11c with identifier: 1984791
2026-03-27 16:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac200acc-d712-5cfa-af90-7fe4a864b11c with scrape type 2
2026-03-27 16:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac200acc-d712-5cfa-af90-7fe4a864b11c with scrape type 2
2026-03-27 16:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ac200acc-d712-5cfa-af90-7fe4a864b11c, identifier: 1984791
2026-03-27 16:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ac200acc-d712-5cfa-af90-7fe4a864b11c with identifier: 1984791
2026-03-27 16:38:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ac200acc-d712-5cfa-af90-7fe4a864b11c with identifier: 1984791
2026-03-27 16:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ac200acc-d712-5cfa-af90-7fe4a864b11c with identifier: 1984791 to the API
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO ALFA PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'ac200acc-d712-5cfa-af90-7fe4a864b11c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV SPRINT AT8 Q4 FP',
'odometer': 82017,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV SPRINT AT8 Q4 '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984791%27 HTTP/1.1" 200 None
2026-03-27 16:38:36 [ayvens.it] INFO: Saving data for 1984791: {'auction_closing_time': 1774859400.0, 'created_time': 1774542898.422018, 'last_price_update_time': 1774629516.734895}
2026-03-27 16:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984791') HTTP/1.1" 204 0
2026-03-27 16:38:37 [ayvens.it] INFO: Found listing with ID: 1984792
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984792%27 HTTP/1.1" 200 None
2026-03-27 16:38:37 [ayvens.it] INFO: Scrape type for 1984792: 2
2026-03-27 16:38:37 [ayvens.it] INFO: Extracting data for car ID: 1984792
2026-03-27 16:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c060093a-c0a7-56ff-a02e-20888a4367d6 with identifier: 1984792
2026-03-27 16:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c060093a-c0a7-56ff-a02e-20888a4367d6 with scrape type 2
2026-03-27 16:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c060093a-c0a7-56ff-a02e-20888a4367d6 with scrape type 2
2026-03-27 16:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c060093a-c0a7-56ff-a02e-20888a4367d6, identifier: 1984792
2026-03-27 16:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c060093a-c0a7-56ff-a02e-20888a4367d6 with identifier: 1984792
2026-03-27 16:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c060093a-c0a7-56ff-a02e-20888a4367d6 with identifier: 1984792
2026-03-27 16:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c060093a-c0a7-56ff-a02e-20888a4367d6 with identifier: 1984792 to the API
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ROSSO ALFA PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'c060093a-c0a7-56ff-a02e-20888a4367d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV EXECUTIVE AT8 Q4 FP',
'odometer': 129228,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO STELVIO 2.2 TURBO DIESEL 190CV EXECUTIVE AT8 '
'Q4 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984792%27 HTTP/1.1" 200 None
2026-03-27 16:38:37 [ayvens.it] INFO: Saving data for 1984792: {'auction_closing_time': 1774859400.0, 'created_time': 1774542883.377165, 'last_price_update_time': 1774629517.691495}
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984792') HTTP/1.1" 204 0
2026-03-27 16:38:37 [ayvens.it] INFO: Found listing with ID: 1984793
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984793%27 HTTP/1.1" 200 None
2026-03-27 16:38:37 [ayvens.it] INFO: Scrape type for 1984793: 2
2026-03-27 16:38:37 [ayvens.it] INFO: Extracting data for car ID: 1984793
2026-03-27 16:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc5e907e-0755-546f-bb62-1acd9547a664 with identifier: 1984793
2026-03-27 16:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc5e907e-0755-546f-bb62-1acd9547a664 with scrape type 2
2026-03-27 16:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc5e907e-0755-546f-bb62-1acd9547a664 with scrape type 2
2026-03-27 16:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: dc5e907e-0755-546f-bb62-1acd9547a664, identifier: 1984793
2026-03-27 16:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e69281d10>
2026-03-27 16:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm1%252F23e9800931dc4ff1a62ae4f3e26d9f06%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/9.jpg saved to cache
2026-03-27 16:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0
2026-03-27 16:38:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f73dd6f7-0c1d-5865-aadf-14399c0c23a0, skipping ID generation
2026-03-27 16:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0 with scrape type 1
2026-03-27 16:38:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f73dd6f7-0c1d-5865-aadf-14399c0c23a0 sending to next pipeline
2026-03-27 16:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f73dd6f7-0c1d-5865-aadf-14399c0c23a0, identifier: 1988824
2026-03-27 16:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68fef690>
2026-03-27 16:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm2%252F0a8f9040d6fe4e8d9573c6766b379258%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/6.jpg saved to cache
2026-03-27 16:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b
2026-03-27 16:38:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01bcef69-d6fc-5feb-834f-6c524a3aec7b, skipping ID generation
2026-03-27 16:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b with scrape type 1
2026-03-27 16:38:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01bcef69-d6fc-5feb-834f-6c524a3aec7b sending to next pipeline
2026-03-27 16:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 01bcef69-d6fc-5feb-834f-6c524a3aec7b, identifier: 1988826
2026-03-27 16:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3e68cdc290>
2026-03-27 16:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.it',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl7%252F4b2899f0f7364ff8b98565d51c2bc4db%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/7.jpg saved to cache
2026-03-27 16:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8876e677-25f4-5cdb-a183-d555b601b569
2026-03-27 16:38:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8876e677-25f4-5cdb-a183-d555b601b569, skipping ID generation
2026-03-27 16:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8876e677-25f4-5cdb-a183-d555b601b569 with scrape type 1
2026-03-27 16:38:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8876e677-25f4-5cdb-a183-d555b601b569 sending to next pipeline
2026-03-27 16:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8876e677-25f4-5cdb-a183-d555b601b569, identifier: 1988825
2026-03-27 16:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: dc5e907e-0755-546f-bb62-1acd9547a664 with identifier: 1984793
2026-03-27 16:38:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: dc5e907e-0755-546f-bb62-1acd9547a664 with identifier: 1984793
2026-03-27 16:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: dc5e907e-0755-546f-bb62-1acd9547a664 with identifier: 1984793 to the API
2026-03-27 16:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.1L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': 'dc5e907e-0755-546f-bb62-1acd9547a664',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FIESTA 1.1 75CV Titanium Hatchback 5-door (Euro 6.2)',
'odometer': 56172,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FIESTA 1.1 75CV Titanium Hatchback 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984793%27 HTTP/1.1" 200 None
2026-03-27 16:38:40 [ayvens.it] INFO: Saving data for 1984793: {'auction_closing_time': 1774859400.0, 'created_time': 1774542866.131697, 'last_price_update_time': 1774629520.327414}
2026-03-27 16:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984793') HTTP/1.1" 204 0
2026-03-27 16:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f73dd6f7-0c1d-5865-aadf-14399c0c23a0 with identifier: 1988824
2026-03-27 16:38:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f73dd6f7-0c1d-5865-aadf-14399c0c23a0 with identifier: 1988824
2026-03-27 16:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f73dd6f7-0c1d-5865-aadf-14399c0c23a0 with identifier: 1988824 to the API
2026-03-27 16:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO MONTAGNA MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.9L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': 'f73dd6f7-0c1d-5865-aadf-14399c0c23a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'MERCEDES GLB (PC) GLB 200 D AUTOMATIC 4MATIC SPORT FP',
'odometer': 79206,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526537,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73dd6f7-0c1d-5865-aadf-14399c0c23a0/f73dd6f7-0c1d-5865-aadf-14399c0c23a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493432,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm1/23e9800931dc4ff1a62ae4f3e26d9f06/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-09',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ MERCEDES GLB (PC) GLB 200 D AUTOMATIC 4MATIC SPORT FP '
'-',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988824%27 HTTP/1.1" 200 None
2026-03-27 16:38:41 [ayvens.it] INFO: Saving data for 1988824: {'created_time': 1774629521.149108, 'last_price_update_time': 1774629521.149118, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988824') HTTP/1.1" 204 0
2026-03-27 16:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 01bcef69-d6fc-5feb-834f-6c524a3aec7b with identifier: 1988826
2026-03-27 16:38:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 01bcef69-d6fc-5feb-834f-6c524a3aec7b with identifier: 1988826
2026-03-27 16:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 01bcef69-d6fc-5feb-834f-6c524a3aec7b with identifier: 1988826 to the API
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO PLATINUM METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '01bcef69-d6fc-5feb-834f-6c524a3aec7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 (PC) BLUEHDI 130 AUTOMATICA PERFORMANCE LINE FP',
'odometer': 152596,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 43,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543875,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550287,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543875,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480475,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 610358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bcef69-d6fc-5feb-834f-6c524a3aec7b/01bcef69-d6fc-5feb-834f-6c524a3aec7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 524480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm2/0a8f9040d6fe4e8d9573c6766b379258/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 (PC) BLUEHDI 130 AUTOMATICA PERFORMANCE LINE '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988826%27 HTTP/1.1" 200 None
2026-03-27 16:38:41 [ayvens.it] INFO: Saving data for 1988826: {'created_time': 1774629521.89247, 'last_price_update_time': 1774629521.892483, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988826') HTTP/1.1" 204 0
2026-03-27 16:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8876e677-25f4-5cdb-a183-d555b601b569 with identifier: 1988825
2026-03-27 16:38:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8876e677-25f4-5cdb-a183-d555b601b569 with identifier: 1988825
2026-03-27 16:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8876e677-25f4-5cdb-a183-d555b601b569 with identifier: 1988825 to the API
2026-03-27 16:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO MYTHOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T08:00:00Z',
'fuel_type': 'diesel',
'id': '8876e677-25f4-5cdb-a183-d555b601b569',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41120',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 30 TDI S tronic Business S.Back Hatchback 5-door (Euro 6D)',
'odometer': 93843,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 949636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 923800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 949636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 863399,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8876e677-25f4-5cdb-a183-d555b601b569/8876e677-25f4-5cdb-a183-d555b601b569_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 612428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl7/4b2899f0f7364ff8b98565d51c2bc4db/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-19',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 30 TDI S tronic Business S.Back Hatchback 5-door (Euro '
'6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271988825%27 HTTP/1.1" 200 None
2026-03-27 16:38:42 [ayvens.it] INFO: Saving data for 1988825: {'created_time': 1774629522.358129, 'last_price_update_time': 1774629522.358139, 'auction_closing_time': 1774944000.0}
2026-03-27 16:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1988825') HTTP/1.1" 204 0
2026-03-27 16:38:43 [ayvens.it] INFO: Found listing with ID: 1984794
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984794%27 HTTP/1.1" 200 None
2026-03-27 16:38:43 [ayvens.it] INFO: Scrape type for 1984794: 2
2026-03-27 16:38:43 [ayvens.it] INFO: Extracting data for car ID: 1984794
2026-03-27 16:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2110bd3b-b1b3-5bcf-be77-6931f02e5687 with identifier: 1984794
2026-03-27 16:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2110bd3b-b1b3-5bcf-be77-6931f02e5687 with scrape type 2
2026-03-27 16:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2110bd3b-b1b3-5bcf-be77-6931f02e5687 with scrape type 2
2026-03-27 16:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2110bd3b-b1b3-5bcf-be77-6931f02e5687, identifier: 1984794
2026-03-27 16:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2110bd3b-b1b3-5bcf-be77-6931f02e5687 with identifier: 1984794
2026-03-27 16:38:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2110bd3b-b1b3-5bcf-be77-6931f02e5687 with identifier: 1984794
2026-03-27 16:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2110bd3b-b1b3-5bcf-be77-6931f02e5687 with identifier: 1984794 to the API
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Meta Black Metallic',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'electric',
'id': '2110bd3b-b1b3-5bcf-be77-6931f02e5687',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'SMART',
'model': 'SMART #1 66 kWh Premium Sport utility vehicle 5-door',
'odometer': 40528,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-09',
'seats_number': 5,
'seller_name': None,
'title': 'SMART SMART #1 66 kWh Premium Sport utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984794%27 HTTP/1.1" 200 None
2026-03-27 16:38:43 [ayvens.it] INFO: Saving data for 1984794: {'auction_closing_time': 1774859400.0, 'created_time': 1774542851.214301, 'last_price_update_time': 1774629523.504574}
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984794') HTTP/1.1" 204 0
2026-03-27 16:38:43 [ayvens.it] INFO: Found listing with ID: 1984795
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984795%27 HTTP/1.1" 200 None
2026-03-27 16:38:43 [ayvens.it] INFO: Scrape type for 1984795: 2
2026-03-27 16:38:43 [ayvens.it] INFO: Extracting data for car ID: 1984795
2026-03-27 16:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc8af34b-c404-5d1b-be52-0b506264a4f2 with identifier: 1984795
2026-03-27 16:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc8af34b-c404-5d1b-be52-0b506264a4f2 with scrape type 2
2026-03-27 16:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc8af34b-c404-5d1b-be52-0b506264a4f2 with scrape type 2
2026-03-27 16:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bc8af34b-c404-5d1b-be52-0b506264a4f2, identifier: 1984795
2026-03-27 16:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bc8af34b-c404-5d1b-be52-0b506264a4f2 with identifier: 1984795
2026-03-27 16:38:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bc8af34b-c404-5d1b-be52-0b506264a4f2 with identifier: 1984795
2026-03-27 16:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bc8af34b-c404-5d1b-be52-0b506264a4f2 with identifier: 1984795 to the API
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Manhattan metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'bc8af34b-c404-5d1b-be52-0b506264a4f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X5 xDrive 30d MH48V Xline autom. Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 54820,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X5 xDrive 30d MH48V Xline autom. Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984795%27 HTTP/1.1" 200 None
2026-03-27 16:38:43 [ayvens.it] INFO: Saving data for 1984795: {'auction_closing_time': 1774859400.0, 'created_time': 1774542858.508667, 'last_price_update_time': 1774629523.941924}
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984795') HTTP/1.1" 204 0
2026-03-27 16:38:43 [ayvens.it] INFO: Found listing with ID: 1984796
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984796%27 HTTP/1.1" 200 None
2026-03-27 16:38:43 [ayvens.it] INFO: Scrape type for 1984796: 2
2026-03-27 16:38:43 [ayvens.it] INFO: Extracting data for car ID: 1984796
2026-03-27 16:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac27778-d229-5330-b15c-b8b87373195d with identifier: 1984796
2026-03-27 16:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac27778-d229-5330-b15c-b8b87373195d with scrape type 2
2026-03-27 16:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac27778-d229-5330-b15c-b8b87373195d with scrape type 2
2026-03-27 16:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: aac27778-d229-5330-b15c-b8b87373195d, identifier: 1984796
2026-03-27 16:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: aac27778-d229-5330-b15c-b8b87373195d with identifier: 1984796
2026-03-27 16:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: aac27778-d229-5330-b15c-b8b87373195d with identifier: 1984796
2026-03-27 16:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: aac27778-d229-5330-b15c-b8b87373195d with identifier: 1984796 to the API
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'r Comment',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'aac27778-d229-5330-b15c-b8b87373195d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FIESTA 1.5 TDCi 85CV Plus Hatchback 5-door (Euro 6)',
'odometer': 181475,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FIESTA 1.5 TDCi 85CV Plus Hatchback 5-door (Euro 6) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984796%27 HTTP/1.1" 200 None
2026-03-27 16:38:44 [ayvens.it] INFO: Saving data for 1984796: {'auction_closing_time': 1774859400.0, 'created_time': 1774542860.700229, 'last_price_update_time': 1774629524.288724}
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984796') HTTP/1.1" 204 0
2026-03-27 16:38:44 [ayvens.it] INFO: Found listing with ID: 1984797
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984797%27 HTTP/1.1" 200 None
2026-03-27 16:38:44 [ayvens.it] INFO: Scrape type for 1984797: 2
2026-03-27 16:38:44 [ayvens.it] INFO: Extracting data for car ID: 1984797
2026-03-27 16:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea8232ba-4006-5e89-bf77-3d09ec5ee39a with identifier: 1984797
2026-03-27 16:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea8232ba-4006-5e89-bf77-3d09ec5ee39a with scrape type 2
2026-03-27 16:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea8232ba-4006-5e89-bf77-3d09ec5ee39a with scrape type 2
2026-03-27 16:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: ea8232ba-4006-5e89-bf77-3d09ec5ee39a, identifier: 1984797
2026-03-27 16:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: ea8232ba-4006-5e89-bf77-3d09ec5ee39a with identifier: 1984797
2026-03-27 16:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: ea8232ba-4006-5e89-bf77-3d09ec5ee39a with identifier: 1984797
2026-03-27 16:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: ea8232ba-4006-5e89-bf77-3d09ec5ee39a with identifier: 1984797 to the API
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Dark Metal Grey metallic',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'ea8232ba-4006-5e89-bf77-3d09ec5ee39a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI 1.5 HEV e-Power Business Auto Cross over 5-door '
'(Euro 6D)',
'odometer': 82230,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI 1.5 HEV e-Power Business Auto Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984797%27 HTTP/1.1" 200 None
2026-03-27 16:38:44 [ayvens.it] INFO: Saving data for 1984797: {'auction_closing_time': 1774859400.0, 'created_time': 1774542882.038438, 'last_price_update_time': 1774629524.749765}
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984797') HTTP/1.1" 204 0
2026-03-27 16:38:44 [ayvens.it] INFO: Found listing with ID: 1984798
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984798%27 HTTP/1.1" 200 None
2026-03-27 16:38:44 [ayvens.it] INFO: Scrape type for 1984798: 2
2026-03-27 16:38:44 [ayvens.it] INFO: Extracting data for car ID: 1984798
2026-03-27 16:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95b4eb2-01b6-5702-b4a6-452669e4780a with identifier: 1984798
2026-03-27 16:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95b4eb2-01b6-5702-b4a6-452669e4780a with scrape type 2
2026-03-27 16:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a95b4eb2-01b6-5702-b4a6-452669e4780a with scrape type 2
2026-03-27 16:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a95b4eb2-01b6-5702-b4a6-452669e4780a, identifier: 1984798
2026-03-27 16:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a95b4eb2-01b6-5702-b4a6-452669e4780a with identifier: 1984798
2026-03-27 16:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a95b4eb2-01b6-5702-b4a6-452669e4780a with identifier: 1984798
2026-03-27 16:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a95b4eb2-01b6-5702-b4a6-452669e4780a with identifier: 1984798 to the API
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': 'a95b4eb2-01b6-5702-b4a6-452669e4780a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP',
'odometer': 95615,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-07',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984798%27 HTTP/1.1" 200 None
2026-03-27 16:38:45 [ayvens.it] INFO: Saving data for 1984798: {'auction_closing_time': 1774859400.0, 'created_time': 1774542883.926678, 'last_price_update_time': 1774629525.245381}
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984798') HTTP/1.1" 204 0
2026-03-27 16:38:45 [ayvens.it] INFO: Found listing with ID: 1984799
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984799%27 HTTP/1.1" 200 None
2026-03-27 16:38:45 [ayvens.it] INFO: Scrape type for 1984799: 2
2026-03-27 16:38:45 [ayvens.it] INFO: Extracting data for car ID: 1984799
2026-03-27 16:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04b0bc03-d0d7-5ac5-b2bc-14f08d3ae566 with identifier: 1984799
2026-03-27 16:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04b0bc03-d0d7-5ac5-b2bc-14f08d3ae566 with scrape type 2
2026-03-27 16:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04b0bc03-d0d7-5ac5-b2bc-14f08d3ae566 with scrape type 2
2026-03-27 16:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 04b0bc03-d0d7-5ac5-b2bc-14f08d3ae566, identifier: 1984799
2026-03-27 16:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 04b0bc03-d0d7-5ac5-b2bc-14f08d3ae566 with identifier: 1984799
2026-03-27 16:38:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 04b0bc03-d0d7-5ac5-b2bc-14f08d3ae566 with identifier: 1984799
2026-03-27 16:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 04b0bc03-d0d7-5ac5-b2bc-14f08d3ae566 with identifier: 1984799 to the API
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLACK SAPPHIRE MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '04b0bc03-d0d7-5ac5-b2bc-14f08d3ae566',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW X1 (PC) SDRIVE 18D EDITION ESSENCE DCT FP',
'odometer': 145991,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-05',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW X1 (PC) SDRIVE 18D EDITION ESSENCE DCT FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984799%27 HTTP/1.1" 200 None
2026-03-27 16:38:45 [ayvens.it] INFO: Saving data for 1984799: {'auction_closing_time': 1774859400.0, 'created_time': 1774542896.752714, 'last_price_update_time': 1774629525.686812}
2026-03-27 16:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984799') HTTP/1.1" 204 0
2026-03-27 16:38:46 [ayvens.it] INFO: Found listing with ID: 1984800
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984800%27 HTTP/1.1" 200 None
2026-03-27 16:38:46 [ayvens.it] INFO: Scrape type for 1984800: 2
2026-03-27 16:38:46 [ayvens.it] INFO: Extracting data for car ID: 1984800
2026-03-27 16:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d5fdd6-79a0-54db-99c5-81326bcdb496 with identifier: 1984800
2026-03-27 16:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d5fdd6-79a0-54db-99c5-81326bcdb496 with scrape type 2
2026-03-27 16:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8d5fdd6-79a0-54db-99c5-81326bcdb496 with scrape type 2
2026-03-27 16:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c8d5fdd6-79a0-54db-99c5-81326bcdb496, identifier: 1984800
2026-03-27 16:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c8d5fdd6-79a0-54db-99c5-81326bcdb496 with identifier: 1984800
2026-03-27 16:38:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c8d5fdd6-79a0-54db-99c5-81326bcdb496 with identifier: 1984800
2026-03-27 16:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c8d5fdd6-79a0-54db-99c5-81326bcdb496 with identifier: 1984800 to the API
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'c8d5fdd6-79a0-54db-99c5-81326bcdb496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) FP',
'odometer': 62639,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSSBACK BLUEHDI 130 AUTOMATICA BUSINESS (PC) '
'FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984800%27 HTTP/1.1" 200 None
2026-03-27 16:38:46 [ayvens.it] INFO: Saving data for 1984800: {'auction_closing_time': 1774859400.0, 'created_time': 1774542894.456747, 'last_price_update_time': 1774629526.705362}
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984800') HTTP/1.1" 204 0
2026-03-27 16:38:46 [ayvens.it] INFO: Found listing with ID: 1984801
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984801%27 HTTP/1.1" 200 None
2026-03-27 16:38:46 [ayvens.it] INFO: Scrape type for 1984801: 2
2026-03-27 16:38:46 [ayvens.it] INFO: Extracting data for car ID: 1984801
2026-03-27 16:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with identifier: 1984801
2026-03-27 16:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with scrape type 2
2026-03-27 16:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with scrape type 2
2026-03-27 16:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5, identifier: 1984801
2026-03-27 16:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with identifier: 1984801
2026-03-27 16:38:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with identifier: 1984801
2026-03-27 16:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0658ef4d-c3c6-5693-abdf-acb7c4ce48d5 with identifier: 1984801 to the API
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRAPHITE GREY MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '0658ef4d-c3c6-5693-abdf-acb7c4ce48d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'JEEP COMPASS (PC) 1.3 T4 PHEV 190CV BUSINESS 4XE AUTO FP',
'odometer': 101308,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP JEEP COMPASS (PC) 1.3 T4 PHEV 190CV BUSINESS 4XE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984801%27 HTTP/1.1" 200 None
2026-03-27 16:38:47 [ayvens.it] INFO: Saving data for 1984801: {'auction_closing_time': 1774859400.0, 'created_time': 1774542893.136227, 'last_price_update_time': 1774629527.093587}
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984801') HTTP/1.1" 204 0
2026-03-27 16:38:47 [ayvens.it] INFO: Found listing with ID: 1984802
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984802%27 HTTP/1.1" 200 None
2026-03-27 16:38:47 [ayvens.it] INFO: Scrape type for 1984802: 2
2026-03-27 16:38:47 [ayvens.it] INFO: Extracting data for car ID: 1984802
2026-03-27 16:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 728a88c5-b57c-5b34-b25e-cc647b4a7cd1 with identifier: 1984802
2026-03-27 16:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728a88c5-b57c-5b34-b25e-cc647b4a7cd1 with scrape type 2
2026-03-27 16:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 728a88c5-b57c-5b34-b25e-cc647b4a7cd1 with scrape type 2
2026-03-27 16:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 728a88c5-b57c-5b34-b25e-cc647b4a7cd1, identifier: 1984802
2026-03-27 16:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 728a88c5-b57c-5b34-b25e-cc647b4a7cd1 with identifier: 1984802
2026-03-27 16:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 728a88c5-b57c-5b34-b25e-cc647b4a7cd1 with identifier: 1984802
2026-03-27 16:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 728a88c5-b57c-5b34-b25e-cc647b4a7cd1 with identifier: 1984802 to the API
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '728a88c5-b57c-5b34-b25e-cc647b4a7cd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN DS 7 CROSS.(PC) BLUEHDI 130 AUTOMATICA PERFORMANCE LINE+ F '
'FP',
'odometer': 48247,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN DS 7 CROSS.(PC) BLUEHDI 130 AUTOMATICA PERFORMANCE '
'LINE+ F FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984802%27 HTTP/1.1" 200 None
2026-03-27 16:38:47 [ayvens.it] INFO: Saving data for 1984802: {'auction_closing_time': 1774859400.0, 'created_time': 1774542888.454887, 'last_price_update_time': 1774629527.475612}
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984802') HTTP/1.1" 204 0
2026-03-27 16:38:47 [ayvens.it] INFO: Found listing with ID: 1984803
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984803%27 HTTP/1.1" 200 None
2026-03-27 16:38:47 [ayvens.it] INFO: Scrape type for 1984803: 2
2026-03-27 16:38:47 [ayvens.it] INFO: Extracting data for car ID: 1984803
2026-03-27 16:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c579849f-f4af-555b-857f-95cc32e7c3c5 with identifier: 1984803
2026-03-27 16:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c579849f-f4af-555b-857f-95cc32e7c3c5 with scrape type 2
2026-03-27 16:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c579849f-f4af-555b-857f-95cc32e7c3c5 with scrape type 2
2026-03-27 16:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: c579849f-f4af-555b-857f-95cc32e7c3c5, identifier: 1984803
2026-03-27 16:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: c579849f-f4af-555b-857f-95cc32e7c3c5 with identifier: 1984803
2026-03-27 16:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: c579849f-f4af-555b-857f-95cc32e7c3c5 with identifier: 1984803
2026-03-27 16:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: c579849f-f4af-555b-857f-95cc32e7c3c5 with identifier: 1984803 to the API
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ALPINE WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'c579849f-f4af-555b-857f-95cc32e7c3c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIES 5 SW 518D M SPORT TOURING',
'odometer': 69607,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIES 5 SW 518D M SPORT TOURING -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984803%27 HTTP/1.1" 200 None
2026-03-27 16:38:47 [ayvens.it] INFO: Saving data for 1984803: {'auction_closing_time': 1774859400.0, 'created_time': 1774542889.371595, 'last_price_update_time': 1774629527.815501}
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984803') HTTP/1.1" 204 0
2026-03-27 16:38:47 [ayvens.it] INFO: Found listing with ID: 1984804
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984804%27 HTTP/1.1" 200 None
2026-03-27 16:38:47 [ayvens.it] INFO: Scrape type for 1984804: 2
2026-03-27 16:38:47 [ayvens.it] INFO: Extracting data for car ID: 1984804
2026-03-27 16:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with identifier: 1984804
2026-03-27 16:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with scrape type 2
2026-03-27 16:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with scrape type 2
2026-03-27 16:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 5e8e7627-842b-5407-a7e8-1d55ef161bd8, identifier: 1984804
2026-03-27 16:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with identifier: 1984804
2026-03-27 16:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with identifier: 1984804
2026-03-27 16:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 5e8e7627-842b-5407-a7e8-1d55ef161bd8 with identifier: 1984804 to the API
2026-03-27 16:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '5e8e7627-842b-5407-a7e8-1d55ef161bd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 55914,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984804%27 HTTP/1.1" 200 None
2026-03-27 16:38:48 [ayvens.it] INFO: Saving data for 1984804: {'auction_closing_time': 1774859400.0, 'created_time': 1774542892.298885, 'last_price_update_time': 1774629528.146494}
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984804') HTTP/1.1" 204 0
2026-03-27 16:38:48 [ayvens.it] INFO: Found listing with ID: 1984805
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984805%27 HTTP/1.1" 200 None
2026-03-27 16:38:48 [ayvens.it] INFO: Scrape type for 1984805: 2
2026-03-27 16:38:48 [ayvens.it] INFO: Extracting data for car ID: 1984805
2026-03-27 16:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e856ce68-1a31-5e29-b1a3-060989b7bdc5 with identifier: 1984805
2026-03-27 16:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e856ce68-1a31-5e29-b1a3-060989b7bdc5 with scrape type 2
2026-03-27 16:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e856ce68-1a31-5e29-b1a3-060989b7bdc5 with scrape type 2
2026-03-27 16:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e856ce68-1a31-5e29-b1a3-060989b7bdc5, identifier: 1984805
2026-03-27 16:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e856ce68-1a31-5e29-b1a3-060989b7bdc5 with identifier: 1984805
2026-03-27 16:38:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e856ce68-1a31-5e29-b1a3-060989b7bdc5 with identifier: 1984805
2026-03-27 16:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e856ce68-1a31-5e29-b1a3-060989b7bdc5 with identifier: 1984805 to the API
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SUMMIT WHITE BRILLIANT',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': 'e856ce68-1a31-5e29-b1a3-060989b7bdc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over 5-door '
'(Euro 6D)',
'odometer': 48774,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND X 1.2 130cv Innovation S&S AT6 Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984805%27 HTTP/1.1" 200 None
2026-03-27 16:38:48 [ayvens.it] INFO: Saving data for 1984805: {'auction_closing_time': 1774859400.0, 'created_time': 1774542893.465146, 'last_price_update_time': 1774629528.571378}
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984805') HTTP/1.1" 204 0
2026-03-27 16:38:48 [ayvens.it] INFO: Found listing with ID: 1984806
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984806%27 HTTP/1.1" 200 None
2026-03-27 16:38:48 [ayvens.it] INFO: Scrape type for 1984806: 2
2026-03-27 16:38:48 [ayvens.it] INFO: Extracting data for car ID: 1984806
2026-03-27 16:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91c83730-6fc1-5118-99c5-29b5b988560b with identifier: 1984806
2026-03-27 16:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c83730-6fc1-5118-99c5-29b5b988560b with scrape type 2
2026-03-27 16:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91c83730-6fc1-5118-99c5-29b5b988560b with scrape type 2
2026-03-27 16:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 91c83730-6fc1-5118-99c5-29b5b988560b, identifier: 1984806
2026-03-27 16:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 91c83730-6fc1-5118-99c5-29b5b988560b with identifier: 1984806
2026-03-27 16:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 91c83730-6fc1-5118-99c5-29b5b988560b with identifier: 1984806
2026-03-27 16:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 91c83730-6fc1-5118-99c5-29b5b988560b with identifier: 1984806 to the API
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'r Comment',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '91c83730-6fc1-5118-99c5-29b5b988560b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'SUZUKI',
'model': 'SUZUKI SX4 S-CROSS 1.0 Boosterjet 2WD Cool Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 185159,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'SUZUKI SUZUKI SX4 S-CROSS 1.0 Boosterjet 2WD Cool Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984806%27 HTTP/1.1" 200 None
2026-03-27 16:38:48 [ayvens.it] INFO: Saving data for 1984806: {'auction_closing_time': 1774859400.0, 'created_time': 1774542895.552738, 'last_price_update_time': 1774629528.93328}
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984806') HTTP/1.1" 204 0
2026-03-27 16:38:48 [ayvens.it] INFO: Found listing with ID: 1984807
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984807%27 HTTP/1.1" 200 None
2026-03-27 16:38:48 [ayvens.it] INFO: Scrape type for 1984807: 2
2026-03-27 16:38:48 [ayvens.it] INFO: Extracting data for car ID: 1984807
2026-03-27 16:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f978f14b-961f-563e-9630-405344a6a317 with identifier: 1984807
2026-03-27 16:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f978f14b-961f-563e-9630-405344a6a317 with scrape type 2
2026-03-27 16:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f978f14b-961f-563e-9630-405344a6a317 with scrape type 2
2026-03-27 16:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: f978f14b-961f-563e-9630-405344a6a317, identifier: 1984807
2026-03-27 16:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: f978f14b-961f-563e-9630-405344a6a317 with identifier: 1984807
2026-03-27 16:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: f978f14b-961f-563e-9630-405344a6a317 with identifier: 1984807
2026-03-27 16:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: f978f14b-961f-563e-9630-405344a6a317 with identifier: 1984807 to the API
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MINERAL WHITE SOLIDO',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'f978f14b-961f-563e-9630-405344a6a317',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN NV250 1.5 dCi 115cv L2 Van Vettura Furgonata 4-door (Euro '
'6.2)',
'odometer': 112043,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN NV250 1.5 dCi 115cv L2 Van Vettura Furgonata 4-door '
'(Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984807%27 HTTP/1.1" 200 None
2026-03-27 16:38:49 [ayvens.it] INFO: Saving data for 1984807: {'auction_closing_time': 1774859400.0, 'created_time': 1774542898.738987, 'last_price_update_time': 1774629529.283432}
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984807') HTTP/1.1" 204 0
2026-03-27 16:38:49 [ayvens.it] INFO: Found listing with ID: 1984808
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984808%27 HTTP/1.1" 200 None
2026-03-27 16:38:49 [ayvens.it] INFO: Scrape type for 1984808: 2
2026-03-27 16:38:49 [ayvens.it] INFO: Extracting data for car ID: 1984808
2026-03-27 16:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39426ff-210f-5420-965e-466a686e6135 with identifier: 1984808
2026-03-27 16:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39426ff-210f-5420-965e-466a686e6135 with scrape type 2
2026-03-27 16:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e39426ff-210f-5420-965e-466a686e6135 with scrape type 2
2026-03-27 16:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e39426ff-210f-5420-965e-466a686e6135, identifier: 1984808
2026-03-27 16:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e39426ff-210f-5420-965e-466a686e6135 with identifier: 1984808
2026-03-27 16:38:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e39426ff-210f-5420-965e-466a686e6135 with identifier: 1984808
2026-03-27 16:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e39426ff-210f-5420-965e-466a686e6135 with identifier: 1984808 to the API
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'HOT RED MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'e39426ff-210f-5420-965e-466a686e6135',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL CROSSLAND (PC) 1.5 DIESEL 120CV ELEGANCE S&S AT6 FP',
'odometer': 170128,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL CROSSLAND (PC) 1.5 DIESEL 120CV ELEGANCE S&S AT6 FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984808%27 HTTP/1.1" 200 None
2026-03-27 16:38:49 [ayvens.it] INFO: Saving data for 1984808: {'auction_closing_time': 1774859400.0, 'created_time': 1774542917.098948, 'last_price_update_time': 1774629529.653154}
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984808') HTTP/1.1" 204 0
2026-03-27 16:38:49 [ayvens.it] INFO: Found listing with ID: 1984809
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984809%27 HTTP/1.1" 200 None
2026-03-27 16:38:49 [ayvens.it] INFO: Scrape type for 1984809: 2
2026-03-27 16:38:49 [ayvens.it] INFO: Extracting data for car ID: 1984809
2026-03-27 16:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with identifier: 1984809
2026-03-27 16:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with scrape type 2
2026-03-27 16:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with scrape type 2
2026-03-27 16:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3, identifier: 1984809
2026-03-27 16:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with identifier: 1984809
2026-03-27 16:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with identifier: 1984809
2026-03-27 16:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6f87711a-f5c1-5de8-aeca-6cfe121e7ef3 with identifier: 1984809 to the API
2026-03-27 16:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ONYX BLACK MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '6f87711a-f5c1-5de8-aeca-6cfe121e7ef3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'VOLVO XC60 B4 D AUTOMATICO CORE FP',
'odometer': 86353,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO VOLVO XC60 B4 D AUTOMATICO CORE FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984809%27 HTTP/1.1" 200 None
2026-03-27 16:38:50 [ayvens.it] INFO: Saving data for 1984809: {'auction_closing_time': 1774859400.0, 'created_time': 1774542916.156478, 'last_price_update_time': 1774629530.816093}
2026-03-27 16:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984809') HTTP/1.1" 204 0
2026-03-27 16:38:50 [ayvens.it] INFO: Found listing with ID: 1984810
2026-03-27 16:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984810%27 HTTP/1.1" 200 None
2026-03-27 16:38:50 [ayvens.it] INFO: Scrape type for 1984810: 2
2026-03-27 16:38:50 [ayvens.it] INFO: Extracting data for car ID: 1984810
2026-03-27 16:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 409acdeb-cb86-546d-9976-9ad026afa383 with identifier: 1984810
2026-03-27 16:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409acdeb-cb86-546d-9976-9ad026afa383 with scrape type 2
2026-03-27 16:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 409acdeb-cb86-546d-9976-9ad026afa383 with scrape type 2
2026-03-27 16:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 409acdeb-cb86-546d-9976-9ad026afa383, identifier: 1984810
2026-03-27 16:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 409acdeb-cb86-546d-9976-9ad026afa383 with identifier: 1984810
2026-03-27 16:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 409acdeb-cb86-546d-9976-9ad026afa383 with identifier: 1984810
2026-03-27 16:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 409acdeb-cb86-546d-9976-9ad026afa383 with identifier: 1984810 to the API
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '409acdeb-cb86-546d-9976-9ad026afa383',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CITROEN JUMPER 33 L3H2 BLUEHDI 120CV FP',
'odometer': 130021,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CITROEN JUMPER 33 L3H2 BLUEHDI 120CV FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984810%27 HTTP/1.1" 200 None
2026-03-27 16:38:51 [ayvens.it] INFO: Saving data for 1984810: {'auction_closing_time': 1774859400.0, 'created_time': 1774542912.25248, 'last_price_update_time': 1774629531.155278}
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984810') HTTP/1.1" 204 0
2026-03-27 16:38:51 [ayvens.it] INFO: Found listing with ID: 1984811
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984811%27 HTTP/1.1" 200 None
2026-03-27 16:38:51 [ayvens.it] INFO: Scrape type for 1984811: 2
2026-03-27 16:38:51 [ayvens.it] INFO: Extracting data for car ID: 1984811
2026-03-27 16:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af00af8c-65dc-51f8-854f-fe35aa83766e with identifier: 1984811
2026-03-27 16:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af00af8c-65dc-51f8-854f-fe35aa83766e with scrape type 2
2026-03-27 16:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af00af8c-65dc-51f8-854f-fe35aa83766e with scrape type 2
2026-03-27 16:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af00af8c-65dc-51f8-854f-fe35aa83766e, identifier: 1984811
2026-03-27 16:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af00af8c-65dc-51f8-854f-fe35aa83766e with identifier: 1984811
2026-03-27 16:38:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af00af8c-65dc-51f8-854f-fe35aa83766e with identifier: 1984811
2026-03-27 16:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af00af8c-65dc-51f8-854f-fe35aa83766e with identifier: 1984811 to the API
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ASTRO METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'af00af8c-65dc-51f8-854f-fe35aa83766e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MASERATI',
'model': 'MASERATI GRECALE (PC) 2.0 300CV MHEV GT Q4 AUTO FP',
'odometer': 110928,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-08',
'seats_number': 5,
'seller_name': None,
'title': 'MASERATI MASERATI GRECALE (PC) 2.0 300CV MHEV GT Q4 AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984811%27 HTTP/1.1" 200 None
2026-03-27 16:38:51 [ayvens.it] INFO: Saving data for 1984811: {'auction_closing_time': 1774859400.0, 'created_time': 1774542904.748235, 'last_price_update_time': 1774629531.511357}
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984811') HTTP/1.1" 204 0
2026-03-27 16:38:51 [ayvens.it] INFO: Found listing with ID: 1984812
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984812%27 HTTP/1.1" 200 None
2026-03-27 16:38:51 [ayvens.it] INFO: Scrape type for 1984812: 2
2026-03-27 16:38:51 [ayvens.it] INFO: Extracting data for car ID: 1984812
2026-03-27 16:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with identifier: 1984812
2026-03-27 16:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with scrape type 2
2026-03-27 16:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with scrape type 2
2026-03-27 16:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b4ae473b-bc06-5240-90d8-f0855cc5c3d7, identifier: 1984812
2026-03-27 16:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with identifier: 1984812
2026-03-27 16:38:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with identifier: 1984812
2026-03-27 16:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b4ae473b-bc06-5240-90d8-f0855cc5c3d7 with identifier: 1984812 to the API
2026-03-27 16:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blu Misano metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'b4ae473b-bc06-5240-90d8-f0855cc5c3d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'ALFA ROMEO',
'model': 'ALFA ROMEO TONALE 1.5 160cv Hybrid TCT7 Veloce Sport utility '
'vehicle 5-door',
'odometer': 39050,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'ALFA ROMEO ALFA ROMEO TONALE 1.5 160cv Hybrid TCT7 Veloce Sport '
'utility vehicle 5-door -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984812%27 HTTP/1.1" 200 None
2026-03-27 16:38:52 [ayvens.it] INFO: Saving data for 1984812: {'auction_closing_time': 1774859400.0, 'created_time': 1774542907.051743, 'last_price_update_time': 1774629532.727484}
2026-03-27 16:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984812') HTTP/1.1" 204 0
2026-03-27 16:38:52 [ayvens.it] INFO: Found listing with ID: 1984813
2026-03-27 16:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984813%27 HTTP/1.1" 200 None
2026-03-27 16:38:52 [ayvens.it] INFO: Scrape type for 1984813: 2
2026-03-27 16:38:52 [ayvens.it] INFO: Extracting data for car ID: 1984813
2026-03-27 16:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44f8cd08-5c50-563e-98c3-00e8f515cc96 with identifier: 1984813
2026-03-27 16:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44f8cd08-5c50-563e-98c3-00e8f515cc96 with scrape type 2
2026-03-27 16:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44f8cd08-5c50-563e-98c3-00e8f515cc96 with scrape type 2
2026-03-27 16:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 44f8cd08-5c50-563e-98c3-00e8f515cc96, identifier: 1984813
2026-03-27 16:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 44f8cd08-5c50-563e-98c3-00e8f515cc96 with identifier: 1984813
2026-03-27 16:38:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 44f8cd08-5c50-563e-98c3-00e8f515cc96 with identifier: 1984813
2026-03-27 16:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 44f8cd08-5c50-563e-98c3-00e8f515cc96 with identifier: 1984813 to the API
2026-03-27 16:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DARK KNIGHT MICALIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '44f8cd08-5c50-563e-98c3-00e8f515cc96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'HYUNDAI TUCSON 1.6 PHEV 4wd 265cv Xline Auto Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 70569,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI HYUNDAI TUCSON 1.6 PHEV 4wd 265cv Xline Auto Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984813%27 HTTP/1.1" 200 None
2026-03-27 16:38:53 [ayvens.it] INFO: Saving data for 1984813: {'auction_closing_time': 1774859400.0, 'created_time': 1774542910.548696, 'last_price_update_time': 1774629533.121073}
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984813') HTTP/1.1" 204 0
2026-03-27 16:38:53 [ayvens.it] INFO: Found listing with ID: 1984814
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984814%27 HTTP/1.1" 200 None
2026-03-27 16:38:53 [ayvens.it] INFO: Scrape type for 1984814: 2
2026-03-27 16:38:53 [ayvens.it] INFO: Extracting data for car ID: 1984814
2026-03-27 16:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1ff467-c230-538d-99bf-198efe7c734b with identifier: 1984814
2026-03-27 16:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1ff467-c230-538d-99bf-198efe7c734b with scrape type 2
2026-03-27 16:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c1ff467-c230-538d-99bf-198efe7c734b with scrape type 2
2026-03-27 16:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 3c1ff467-c230-538d-99bf-198efe7c734b, identifier: 1984814
2026-03-27 16:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 3c1ff467-c230-538d-99bf-198efe7c734b with identifier: 1984814
2026-03-27 16:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 3c1ff467-c230-538d-99bf-198efe7c734b with identifier: 1984814
2026-03-27 16:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 3c1ff467-c230-538d-99bf-198efe7c734b with identifier: 1984814 to the API
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Frozen White pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '3c1ff467-c230-538d-99bf-198efe7c734b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT T/P 350 L4 Trend 2.0 HDT 165 cv Cabinato 2-door',
'odometer': 12173,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT T/P 350 L4 Trend 2.0 HDT 165 cv Cabinato 2-door -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2025}
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984814%27 HTTP/1.1" 200 None
2026-03-27 16:38:53 [ayvens.it] INFO: Saving data for 1984814: {'auction_closing_time': 1774859400.0, 'created_time': 1774542909.099883, 'last_price_update_time': 1774629533.48869}
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984814') HTTP/1.1" 204 0
2026-03-27 16:38:53 [ayvens.it] INFO: Found listing with ID: 1984815
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984815%27 HTTP/1.1" 200 None
2026-03-27 16:38:53 [ayvens.it] INFO: Scrape type for 1984815: 2
2026-03-27 16:38:53 [ayvens.it] INFO: Extracting data for car ID: 1984815
2026-03-27 16:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67a04f9-becc-5298-9202-b771e044849b with identifier: 1984815
2026-03-27 16:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67a04f9-becc-5298-9202-b771e044849b with scrape type 2
2026-03-27 16:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a67a04f9-becc-5298-9202-b771e044849b with scrape type 2
2026-03-27 16:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: a67a04f9-becc-5298-9202-b771e044849b, identifier: 1984815
2026-03-27 16:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: a67a04f9-becc-5298-9202-b771e044849b with identifier: 1984815
2026-03-27 16:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: a67a04f9-becc-5298-9202-b771e044849b with identifier: 1984815
2026-03-27 16:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: a67a04f9-becc-5298-9202-b771e044849b with identifier: 1984815 to the API
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'CHROME BLUE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'a67a04f9-becc-5298-9202-b771e044849b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW',
'odometer': 116333,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD FOCUS SW (PC) 1.0 ECOB. HYBR. 125CV ST-LINE DES.AUTOSW -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984815%27 HTTP/1.1" 200 None
2026-03-27 16:38:53 [ayvens.it] INFO: Saving data for 1984815: {'auction_closing_time': 1774859400.0, 'created_time': 1774542911.911298, 'last_price_update_time': 1774629533.843375}
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984815') HTTP/1.1" 204 0
2026-03-27 16:38:53 [ayvens.it] INFO: Found listing with ID: 1984816
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984816%27 HTTP/1.1" 200 None
2026-03-27 16:38:53 [ayvens.it] INFO: Scrape type for 1984816: 2
2026-03-27 16:38:53 [ayvens.it] INFO: Extracting data for car ID: 1984816
2026-03-27 16:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c31dab5-aff9-59b0-a7e6-899d35bf270c with identifier: 1984816
2026-03-27 16:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c31dab5-aff9-59b0-a7e6-899d35bf270c with scrape type 2
2026-03-27 16:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c31dab5-aff9-59b0-a7e6-899d35bf270c with scrape type 2
2026-03-27 16:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4c31dab5-aff9-59b0-a7e6-899d35bf270c, identifier: 1984816
2026-03-27 16:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4c31dab5-aff9-59b0-a7e6-899d35bf270c with identifier: 1984816
2026-03-27 16:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4c31dab5-aff9-59b0-a7e6-899d35bf270c with identifier: 1984816
2026-03-27 16:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4c31dab5-aff9-59b0-a7e6-899d35bf270c with identifier: 1984816 to the API
2026-03-27 16:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GELATO PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '4c31dab5-aff9-59b0-a7e6-899d35bf270c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP',
'odometer': 102926,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP13 0.9 TWINAIR TURBO 85CV S&S E6-TEMP 4X4 FP '
'-',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984816%27 HTTP/1.1" 200 None
2026-03-27 16:38:56 [ayvens.it] INFO: Saving data for 1984816: {'auction_closing_time': 1774859400.0, 'created_time': 1774542914.015361, 'last_price_update_time': 1774629536.40198}
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984816') HTTP/1.1" 204 0
2026-03-27 16:38:56 [ayvens.it] INFO: Found listing with ID: 1984817
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984817%27 HTTP/1.1" 200 None
2026-03-27 16:38:56 [ayvens.it] INFO: Scrape type for 1984817: 2
2026-03-27 16:38:56 [ayvens.it] INFO: Extracting data for car ID: 1984817
2026-03-27 16:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6859d15b-a63d-508d-ac3e-167906ce6430 with identifier: 1984817
2026-03-27 16:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6859d15b-a63d-508d-ac3e-167906ce6430 with scrape type 2
2026-03-27 16:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6859d15b-a63d-508d-ac3e-167906ce6430 with scrape type 2
2026-03-27 16:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 6859d15b-a63d-508d-ac3e-167906ce6430, identifier: 1984817
2026-03-27 16:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 6859d15b-a63d-508d-ac3e-167906ce6430 with identifier: 1984817
2026-03-27 16:38:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 6859d15b-a63d-508d-ac3e-167906ce6430 with identifier: 1984817
2026-03-27 16:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 6859d15b-a63d-508d-ac3e-167906ce6430 with identifier: 1984817 to the API
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DEEP BLACK PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '6859d15b-a63d-508d-ac3e-167906ce6430',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW ELEGANCE DSG FP',
'odometer': 173247,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW ELEGANCE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984817%27 HTTP/1.1" 200 None
2026-03-27 16:38:56 [ayvens.it] INFO: Saving data for 1984817: {'auction_closing_time': 1774859400.0, 'created_time': 1774542915.365005, 'last_price_update_time': 1774629536.79691}
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984817') HTTP/1.1" 204 0
2026-03-27 16:38:56 [ayvens.it] INFO: Found listing with ID: 1984818
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984818%27 HTTP/1.1" 200 None
2026-03-27 16:38:56 [ayvens.it] INFO: Scrape type for 1984818: 2
2026-03-27 16:38:56 [ayvens.it] INFO: Extracting data for car ID: 1984818
2026-03-27 16:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a1bf695-0053-565a-a606-cc16cdfc7e8f with identifier: 1984818
2026-03-27 16:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a1bf695-0053-565a-a606-cc16cdfc7e8f with scrape type 2
2026-03-27 16:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a1bf695-0053-565a-a606-cc16cdfc7e8f with scrape type 2
2026-03-27 16:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2a1bf695-0053-565a-a606-cc16cdfc7e8f, identifier: 1984818
2026-03-27 16:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2a1bf695-0053-565a-a606-cc16cdfc7e8f with identifier: 1984818
2026-03-27 16:38:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2a1bf695-0053-565a-a606-cc16cdfc7e8f with identifier: 1984818
2026-03-27 16:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2a1bf695-0053-565a-a606-cc16cdfc7e8f with identifier: 1984818 to the API
2026-03-27 16:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO SCURO MICALIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '2a1bf695-0053-565a-a606-cc16cdfc7e8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'KIA SPORTAGE 1.6 CRDI MHEV BUSINESS 2WD DCT',
'odometer': 118208,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'KIA KIA SPORTAGE 1.6 CRDI MHEV BUSINESS 2WD DCT -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984818%27 HTTP/1.1" 200 None
2026-03-27 16:38:58 [ayvens.it] INFO: Saving data for 1984818: {'auction_closing_time': 1774859400.0, 'created_time': 1774542919.321473, 'last_price_update_time': 1774629538.355557}
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984818') HTTP/1.1" 204 0
2026-03-27 16:38:58 [ayvens.it] INFO: Found listing with ID: 1984819
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984819%27 HTTP/1.1" 200 None
2026-03-27 16:38:58 [ayvens.it] INFO: Scrape type for 1984819: 2
2026-03-27 16:38:58 [ayvens.it] INFO: Extracting data for car ID: 1984819
2026-03-27 16:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e110f788-e6e7-57aa-b596-0eee276ad687 with identifier: 1984819
2026-03-27 16:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e110f788-e6e7-57aa-b596-0eee276ad687 with scrape type 2
2026-03-27 16:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e110f788-e6e7-57aa-b596-0eee276ad687 with scrape type 2
2026-03-27 16:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e110f788-e6e7-57aa-b596-0eee276ad687, identifier: 1984819
2026-03-27 16:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e110f788-e6e7-57aa-b596-0eee276ad687 with identifier: 1984819
2026-03-27 16:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e110f788-e6e7-57aa-b596-0eee276ad687 with identifier: 1984819
2026-03-27 16:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e110f788-e6e7-57aa-b596-0eee276ad687 with identifier: 1984819 to the API
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO ICY PASTELLO',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'e110f788-e6e7-57aa-b596-0eee276ad687',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL MOVANO CAB (PC) AUTOT. EDIT 35 HEAVY L3 BLUEHDI 140 S&S FP',
'odometer': 76793,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-16',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL MOVANO CAB (PC) AUTOT. EDIT 35 HEAVY L3 BLUEHDI 140 S&S '
'FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984819%27 HTTP/1.1" 200 None
2026-03-27 16:38:58 [ayvens.it] INFO: Saving data for 1984819: {'auction_closing_time': 1774859400.0, 'created_time': 1774542918.932852, 'last_price_update_time': 1774629538.688386}
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984819') HTTP/1.1" 204 0
2026-03-27 16:38:58 [ayvens.it] INFO: Found listing with ID: 1984820
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984820%27 HTTP/1.1" 200 None
2026-03-27 16:38:58 [ayvens.it] INFO: Scrape type for 1984820: 2
2026-03-27 16:38:58 [ayvens.it] INFO: Extracting data for car ID: 1984820
2026-03-27 16:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with identifier: 1984820
2026-03-27 16:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with scrape type 2
2026-03-27 16:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with scrape type 2
2026-03-27 16:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f, identifier: 1984820
2026-03-27 16:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with identifier: 1984820
2026-03-27 16:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with identifier: 1984820
2026-03-27 16:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 9eade3b8-62c8-57d2-a3c4-86d2de57eb8f with identifier: 1984820 to the API
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Deep Black perla',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '9eade3b8-62c8-57d2-a3c4-86d2de57eb8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Business BMT DSG Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 495609,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Business BMT DSG '
'Sport utility vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984820%27 HTTP/1.1" 200 None
2026-03-27 16:38:59 [ayvens.it] INFO: Saving data for 1984820: {'auction_closing_time': 1774859400.0, 'created_time': 1774542921.986865, 'last_price_update_time': 1774629539.017048}
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984820') HTTP/1.1" 204 0
2026-03-27 16:38:59 [ayvens.it] INFO: Found listing with ID: 1984821
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984821%27 HTTP/1.1" 200 None
2026-03-27 16:38:59 [ayvens.it] INFO: Scrape type for 1984821: 2
2026-03-27 16:38:59 [ayvens.it] INFO: Extracting data for car ID: 1984821
2026-03-27 16:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with identifier: 1984821
2026-03-27 16:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with scrape type 2
2026-03-27 16:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with scrape type 2
2026-03-27 16:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20, identifier: 1984821
2026-03-27 16:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with identifier: 1984821
2026-03-27 16:38:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with identifier: 1984821
2026-03-27 16:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 62fdd4ff-9dc0-5400-9b7c-fee20d548d20 with identifier: 1984821 to the API
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Nero Perla',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '62fdd4ff-9dc0-5400-9b7c-fee20d548d20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 2008 BlueHDi 130 EAT8 Allure S/S aut. Cross over 5-door '
'(Euro 6D)',
'odometer': 47758,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 2008 BlueHDi 130 EAT8 Allure S/S aut. Cross over '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984821%27 HTTP/1.1" 200 None
2026-03-27 16:38:59 [ayvens.it] INFO: Saving data for 1984821: {'auction_closing_time': 1774859400.0, 'created_time': 1774542923.482701, 'last_price_update_time': 1774629539.422811}
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984821') HTTP/1.1" 204 0
2026-03-27 16:38:59 [ayvens.it] INFO: Found listing with ID: 1984822
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984822%27 HTTP/1.1" 200 None
2026-03-27 16:38:59 [ayvens.it] INFO: Scrape type for 1984822: 2
2026-03-27 16:38:59 [ayvens.it] INFO: Extracting data for car ID: 1984822
2026-03-27 16:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a4245a-8726-53dc-b2bf-185b74e0ce4d with identifier: 1984822
2026-03-27 16:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a4245a-8726-53dc-b2bf-185b74e0ce4d with scrape type 2
2026-03-27 16:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5a4245a-8726-53dc-b2bf-185b74e0ce4d with scrape type 2
2026-03-27 16:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: e5a4245a-8726-53dc-b2bf-185b74e0ce4d, identifier: 1984822
2026-03-27 16:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: e5a4245a-8726-53dc-b2bf-185b74e0ce4d with identifier: 1984822
2026-03-27 16:38:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: e5a4245a-8726-53dc-b2bf-185b74e0ce4d with identifier: 1984822
2026-03-27 16:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: e5a4245a-8726-53dc-b2bf-185b74e0ce4d with identifier: 1984822 to the API
2026-03-27 16:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'White Jade brilliant',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'e5a4245a-8726-53dc-b2bf-185b74e0ce4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'OPEL GRANDLAND 1.5 130cv GS Line AT8 Sport utility vehicle 5-door '
'(Euro 6D)',
'odometer': 150216,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-17',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL OPEL GRANDLAND 1.5 130cv GS Line AT8 Sport utility vehicle '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984822%27 HTTP/1.1" 200 None
2026-03-27 16:39:00 [ayvens.it] INFO: Saving data for 1984822: {'auction_closing_time': 1774859400.0, 'created_time': 1774542931.211983, 'last_price_update_time': 1774629540.248433}
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984822') HTTP/1.1" 204 0
2026-03-27 16:39:00 [ayvens.it] INFO: Found listing with ID: 1984823
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984823%27 HTTP/1.1" 200 None
2026-03-27 16:39:00 [ayvens.it] INFO: Scrape type for 1984823: 2
2026-03-27 16:39:00 [ayvens.it] INFO: Extracting data for car ID: 1984823
2026-03-27 16:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with identifier: 1984823
2026-03-27 16:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with scrape type 2
2026-03-27 16:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with scrape type 2
2026-03-27 16:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce, identifier: 1984823
2026-03-27 16:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with identifier: 1984823
2026-03-27 16:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with identifier: 1984823
2026-03-27 16:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce with identifier: 1984823 to the API
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'afe2f8ca-8ddf-5679-ad3a-f23a1f3a7dce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC)',
'odometer': 62259,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-17',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT COURIER 1.5 TDCI 75 CV TREND FP (PC) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984823%27 HTTP/1.1" 200 None
2026-03-27 16:39:00 [ayvens.it] INFO: Saving data for 1984823: {'auction_closing_time': 1774859400.0, 'created_time': 1774542930.323638, 'last_price_update_time': 1774629540.612422}
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984823') HTTP/1.1" 204 0
2026-03-27 16:39:00 [ayvens.it] INFO: Found listing with ID: 1984824
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984824%27 HTTP/1.1" 200 None
2026-03-27 16:39:00 [ayvens.it] INFO: Scrape type for 1984824: 2
2026-03-27 16:39:00 [ayvens.it] INFO: Extracting data for car ID: 1984824
2026-03-27 16:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf151883-8513-5933-a967-cbce5c38af34 with identifier: 1984824
2026-03-27 16:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf151883-8513-5933-a967-cbce5c38af34 with scrape type 2
2026-03-27 16:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf151883-8513-5933-a967-cbce5c38af34 with scrape type 2
2026-03-27 16:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cf151883-8513-5933-a967-cbce5c38af34, identifier: 1984824
2026-03-27 16:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cf151883-8513-5933-a967-cbce5c38af34 with identifier: 1984824
2026-03-27 16:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cf151883-8513-5933-a967-cbce5c38af34 with identifier: 1984824
2026-03-27 16:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cf151883-8513-5933-a967-cbce5c38af34 with identifier: 1984824 to the API
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO ETOILE MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'cf151883-8513-5933-a967-cbce5c38af34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT MEGANE SW N1 1.5 DCI 85KW BLUE EQUILIBRE FP',
'odometer': 47018,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT MEGANE SW N1 1.5 DCI 85KW BLUE EQUILIBRE FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984824%27 HTTP/1.1" 200 None
2026-03-27 16:39:00 [ayvens.it] INFO: Saving data for 1984824: {'auction_closing_time': 1774859400.0, 'created_time': 1774542928.846765, 'last_price_update_time': 1774629540.988108}
2026-03-27 16:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984824') HTTP/1.1" 204 0
2026-03-27 16:39:01 [ayvens.it] INFO: Found listing with ID: 1984825
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984825%27 HTTP/1.1" 200 None
2026-03-27 16:39:01 [ayvens.it] INFO: Scrape type for 1984825: 2
2026-03-27 16:39:01 [ayvens.it] INFO: Extracting data for car ID: 1984825
2026-03-27 16:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with identifier: 1984825
2026-03-27 16:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with scrape type 2
2026-03-27 16:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with scrape type 2
2026-03-27 16:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850, identifier: 1984825
2026-03-27 16:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with identifier: 1984825
2026-03-27 16:39:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with identifier: 1984825
2026-03-27 16:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 20f386ed-2d2a-5c9e-aece-b5d6b8a4b850 with identifier: 1984825 to the API
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'DARK METAL GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '20f386ed-2d2a-5c9e-aece-b5d6b8a4b850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'NISSAN QASHQAI (PC) 1.5 HEV E-POWER BUSINESS AUTO FP',
'odometer': 97572,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN NISSAN QASHQAI (PC) 1.5 HEV E-POWER BUSINESS AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984825%27 HTTP/1.1" 200 None
2026-03-27 16:39:01 [ayvens.it] INFO: Saving data for 1984825: {'auction_closing_time': 1774859400.0, 'created_time': 1774542929.275473, 'last_price_update_time': 1774629541.372258}
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984825') HTTP/1.1" 204 0
2026-03-27 16:39:01 [ayvens.it] INFO: Found listing with ID: 1984826
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984826%27 HTTP/1.1" 200 None
2026-03-27 16:39:01 [ayvens.it] INFO: Scrape type for 1984826: 2
2026-03-27 16:39:01 [ayvens.it] INFO: Extracting data for car ID: 1984826
2026-03-27 16:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a7c452b-9a35-5b38-98ef-4f4b10f8eb74 with identifier: 1984826
2026-03-27 16:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a7c452b-9a35-5b38-98ef-4f4b10f8eb74 with scrape type 2
2026-03-27 16:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a7c452b-9a35-5b38-98ef-4f4b10f8eb74 with scrape type 2
2026-03-27 16:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 8a7c452b-9a35-5b38-98ef-4f4b10f8eb74, identifier: 1984826
2026-03-27 16:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 8a7c452b-9a35-5b38-98ef-4f4b10f8eb74 with identifier: 1984826
2026-03-27 16:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 8a7c452b-9a35-5b38-98ef-4f4b10f8eb74 with identifier: 1984826
2026-03-27 16:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 8a7c452b-9a35-5b38-98ef-4f4b10f8eb74 with identifier: 1984826 to the API
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Frozen White pastello',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '8a7c452b-9a35-5b38-98ef-4f4b10f8eb74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT 350 L2H2 Trend 2.0 Eco 130 Cv Furgone 4-door (Euro '
'6.2)',
'odometer': 126252,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT 350 L2H2 Trend 2.0 Eco 130 Cv Furgone 4-door '
'(Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984826%27 HTTP/1.1" 200 None
2026-03-27 16:39:01 [ayvens.it] INFO: Saving data for 1984826: {'auction_closing_time': 1774859400.0, 'created_time': 1774542932.461669, 'last_price_update_time': 1774629541.726993}
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984826') HTTP/1.1" 204 0
2026-03-27 16:39:01 [ayvens.it] INFO: Found listing with ID: 1984827
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984827%27 HTTP/1.1" 200 None
2026-03-27 16:39:01 [ayvens.it] INFO: Scrape type for 1984827: 2
2026-03-27 16:39:01 [ayvens.it] INFO: Extracting data for car ID: 1984827
2026-03-27 16:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54b23299-dabc-5552-ac7a-1dc763659be0 with identifier: 1984827
2026-03-27 16:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54b23299-dabc-5552-ac7a-1dc763659be0 with scrape type 2
2026-03-27 16:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54b23299-dabc-5552-ac7a-1dc763659be0 with scrape type 2
2026-03-27 16:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 54b23299-dabc-5552-ac7a-1dc763659be0, identifier: 1984827
2026-03-27 16:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 54b23299-dabc-5552-ac7a-1dc763659be0 with identifier: 1984827
2026-03-27 16:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 54b23299-dabc-5552-ac7a-1dc763659be0 with identifier: 1984827
2026-03-27 16:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 54b23299-dabc-5552-ac7a-1dc763659be0 with identifier: 1984827 to the API
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLU NAVARRA METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '54b23299-dabc-5552-ac7a-1dc763659be0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A3 35 TFSI S TRONIC BUSINESS ADV. S.BACK FP',
'odometer': 208982,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A3 35 TFSI S TRONIC BUSINESS ADV. S.BACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984827%27 HTTP/1.1" 200 None
2026-03-27 16:39:02 [ayvens.it] INFO: Saving data for 1984827: {'auction_closing_time': 1774859400.0, 'created_time': 1774542935.412773, 'last_price_update_time': 1774629542.193305}
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984827') HTTP/1.1" 204 0
2026-03-27 16:39:02 [ayvens.it] INFO: Found listing with ID: 1984828
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984828%27 HTTP/1.1" 200 None
2026-03-27 16:39:02 [ayvens.it] INFO: Scrape type for 1984828: 2
2026-03-27 16:39:02 [ayvens.it] INFO: Extracting data for car ID: 1984828
2026-03-27 16:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00d6555a-ac80-5e47-943c-fc949c7b7d82 with identifier: 1984828
2026-03-27 16:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00d6555a-ac80-5e47-943c-fc949c7b7d82 with scrape type 2
2026-03-27 16:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00d6555a-ac80-5e47-943c-fc949c7b7d82 with scrape type 2
2026-03-27 16:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 00d6555a-ac80-5e47-943c-fc949c7b7d82, identifier: 1984828
2026-03-27 16:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 00d6555a-ac80-5e47-943c-fc949c7b7d82 with identifier: 1984828
2026-03-27 16:39:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 00d6555a-ac80-5e47-943c-fc949c7b7d82 with identifier: 1984828
2026-03-27 16:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 00d6555a-ac80-5e47-943c-fc949c7b7d82 with identifier: 1984828 to the API
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SAPHIRSCHWARZ MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '00d6555a-ac80-5e47-943c-fc949c7b7d82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'BMW SERIES 5 SW 520D XDRIVE BUSINESS AUTO MH48V TOURING FP',
'odometer': 162630,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'BMW BMW SERIES 5 SW 520D XDRIVE BUSINESS AUTO MH48V TOURING FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984828%27 HTTP/1.1" 200 None
2026-03-27 16:39:02 [ayvens.it] INFO: Saving data for 1984828: {'auction_closing_time': 1774859400.0, 'created_time': 1774542937.178142, 'last_price_update_time': 1774629542.549476}
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984828') HTTP/1.1" 204 0
2026-03-27 16:39:02 [ayvens.it] INFO: Found listing with ID: 1984829
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984829%27 HTTP/1.1" 200 None
2026-03-27 16:39:02 [ayvens.it] INFO: Scrape type for 1984829: 2
2026-03-27 16:39:02 [ayvens.it] INFO: Extracting data for car ID: 1984829
2026-03-27 16:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45700d38-f122-5012-ba24-059b596e0b5e with identifier: 1984829
2026-03-27 16:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45700d38-f122-5012-ba24-059b596e0b5e with scrape type 2
2026-03-27 16:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45700d38-f122-5012-ba24-059b596e0b5e with scrape type 2
2026-03-27 16:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 45700d38-f122-5012-ba24-059b596e0b5e, identifier: 1984829
2026-03-27 16:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 45700d38-f122-5012-ba24-059b596e0b5e with identifier: 1984829
2026-03-27 16:39:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 45700d38-f122-5012-ba24-059b596e0b5e with identifier: 1984829
2026-03-27 16:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 45700d38-f122-5012-ba24-059b596e0b5e with identifier: 1984829 to the API
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO GHIACCIO MTZ',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '45700d38-f122-5012-ba24-059b596e0b5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q5 (PC) 35 TDI S TRONIC',
'odometer': 221080,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-02',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q5 (PC) 35 TDI S TRONIC -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984829%27 HTTP/1.1" 200 None
2026-03-27 16:39:02 [ayvens.it] INFO: Saving data for 1984829: {'auction_closing_time': 1774859400.0, 'created_time': 1774542939.093296, 'last_price_update_time': 1774629542.912156}
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984829') HTTP/1.1" 204 0
2026-03-27 16:39:02 [ayvens.it] INFO: Found listing with ID: 1984830
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984830%27 HTTP/1.1" 200 None
2026-03-27 16:39:02 [ayvens.it] INFO: Scrape type for 1984830: 2
2026-03-27 16:39:02 [ayvens.it] INFO: Extracting data for car ID: 1984830
2026-03-27 16:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf808f6-5e0a-5b89-a8a3-8b67f9128c37 with identifier: 1984830
2026-03-27 16:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf808f6-5e0a-5b89-a8a3-8b67f9128c37 with scrape type 2
2026-03-27 16:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf808f6-5e0a-5b89-a8a3-8b67f9128c37 with scrape type 2
2026-03-27 16:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: cbf808f6-5e0a-5b89-a8a3-8b67f9128c37, identifier: 1984830
2026-03-27 16:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: cbf808f6-5e0a-5b89-a8a3-8b67f9128c37 with identifier: 1984830
2026-03-27 16:39:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: cbf808f6-5e0a-5b89-a8a3-8b67f9128c37 with identifier: 1984830
2026-03-27 16:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: cbf808f6-5e0a-5b89-a8a3-8b67f9128c37 with identifier: 1984830 to the API
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MOONSTONE GREY PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'cbf808f6-5e0a-5b89-a8a3-8b67f9128c37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN GOLF 2.0 TDI SCR 110KW LIFE DSG FP',
'odometer': 93181,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN GOLF 2.0 TDI SCR 110KW LIFE DSG FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984830%27 HTTP/1.1" 200 None
2026-03-27 16:39:03 [ayvens.it] INFO: Saving data for 1984830: {'auction_closing_time': 1774859400.0, 'created_time': 1774542940.728145, 'last_price_update_time': 1774629543.274737}
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984830') HTTP/1.1" 204 0
2026-03-27 16:39:03 [ayvens.it] INFO: Found listing with ID: 1984831
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984831%27 HTTP/1.1" 200 None
2026-03-27 16:39:03 [ayvens.it] INFO: Scrape type for 1984831: 2
2026-03-27 16:39:03 [ayvens.it] INFO: Extracting data for car ID: 1984831
2026-03-27 16:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d95c0e-7313-5c88-9a72-b702e1a1f0a7 with identifier: 1984831
2026-03-27 16:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d95c0e-7313-5c88-9a72-b702e1a1f0a7 with scrape type 2
2026-03-27 16:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22d95c0e-7313-5c88-9a72-b702e1a1f0a7 with scrape type 2
2026-03-27 16:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 22d95c0e-7313-5c88-9a72-b702e1a1f0a7, identifier: 1984831
2026-03-27 16:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 22d95c0e-7313-5c88-9a72-b702e1a1f0a7 with identifier: 1984831
2026-03-27 16:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 22d95c0e-7313-5c88-9a72-b702e1a1f0a7 with identifier: 1984831
2026-03-27 16:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 22d95c0e-7313-5c88-9a72-b702e1a1f0a7 with identifier: 1984831 to the API
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'R COMMENT',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '22d95c0e-7313-5c88-9a72-b702e1a1f0a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT 290 L2H2 Trend 2.0TDCi MHEV 130 Cv Eco Furgone 4-door '
'(Euro 6.2)',
'odometer': 47988,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT 290 L2H2 Trend 2.0TDCi MHEV 130 Cv Eco Furgone '
'4-door (Euro 6.2) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984831%27 HTTP/1.1" 200 None
2026-03-27 16:39:03 [ayvens.it] INFO: Saving data for 1984831: {'auction_closing_time': 1774859400.0, 'created_time': 1774542942.300626, 'last_price_update_time': 1774629543.634071}
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984831') HTTP/1.1" 204 0
2026-03-27 16:39:03 [ayvens.it] INFO: Found listing with ID: 1984832
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984832%27 HTTP/1.1" 200 None
2026-03-27 16:39:03 [ayvens.it] INFO: Scrape type for 1984832: 2
2026-03-27 16:39:03 [ayvens.it] INFO: Extracting data for car ID: 1984832
2026-03-27 16:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ccaf8c-a041-5b98-baa7-dd306d956bcc with identifier: 1984832
2026-03-27 16:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ccaf8c-a041-5b98-baa7-dd306d956bcc with scrape type 2
2026-03-27 16:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7ccaf8c-a041-5b98-baa7-dd306d956bcc with scrape type 2
2026-03-27 16:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d7ccaf8c-a041-5b98-baa7-dd306d956bcc, identifier: 1984832
2026-03-27 16:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d7ccaf8c-a041-5b98-baa7-dd306d956bcc with identifier: 1984832
2026-03-27 16:39:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d7ccaf8c-a041-5b98-baa7-dd306d956bcc with identifier: 1984832
2026-03-27 16:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d7ccaf8c-a041-5b98-baa7-dd306d956bcc with identifier: 1984832 to the API
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO GRAFITE METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'd7ccaf8c-a041-5b98-baa7-dd306d956bcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'RENAULT ARKANA 1.6 full hybrid E-Tech TECHNO Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 215055,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-07',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT RENAULT ARKANA 1.6 full hybrid E-Tech TECHNO Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984832%27 HTTP/1.1" 200 None
2026-03-27 16:39:03 [ayvens.it] INFO: Saving data for 1984832: {'auction_closing_time': 1774859400.0, 'created_time': 1774542943.733836, 'last_price_update_time': 1774629543.990785}
2026-03-27 16:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984832') HTTP/1.1" 204 0
2026-03-27 16:39:04 [ayvens.it] INFO: Found listing with ID: 1984833
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984833%27 HTTP/1.1" 200 None
2026-03-27 16:39:04 [ayvens.it] INFO: Scrape type for 1984833: 2
2026-03-27 16:39:04 [ayvens.it] INFO: Extracting data for car ID: 1984833
2026-03-27 16:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf9bca7a-cde3-5ab7-8fd2-0ca905fb011a with identifier: 1984833
2026-03-27 16:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf9bca7a-cde3-5ab7-8fd2-0ca905fb011a with scrape type 2
2026-03-27 16:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf9bca7a-cde3-5ab7-8fd2-0ca905fb011a with scrape type 2
2026-03-27 16:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: bf9bca7a-cde3-5ab7-8fd2-0ca905fb011a, identifier: 1984833
2026-03-27 16:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: bf9bca7a-cde3-5ab7-8fd2-0ca905fb011a with identifier: 1984833
2026-03-27 16:39:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: bf9bca7a-cde3-5ab7-8fd2-0ca905fb011a with identifier: 1984833
2026-03-27 16:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: bf9bca7a-cde3-5ab7-8fd2-0ca905fb011a with identifier: 1984833 to the API
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blu Mediterraneo metallizzato',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': 'bf9bca7a-cde3-5ab7-8fd2-0ca905fb011a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA 1.2 69cv E6 Easy_',
'odometer': 120746,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA 1.2 69cv E6 Easy_ -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2016}
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984833%27 HTTP/1.1" 200 None
2026-03-27 16:39:04 [ayvens.it] INFO: Saving data for 1984833: {'auction_closing_time': 1774859400.0, 'created_time': 1774542945.389211, 'last_price_update_time': 1774629544.353798}
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984833') HTTP/1.1" 204 0
2026-03-27 16:39:04 [ayvens.it] INFO: Found listing with ID: 1984834
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984834%27 HTTP/1.1" 200 None
2026-03-27 16:39:04 [ayvens.it] INFO: Scrape type for 1984834: 2
2026-03-27 16:39:04 [ayvens.it] INFO: Extracting data for car ID: 1984834
2026-03-27 16:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42f5cb23-1f97-5b4d-a867-b973fdba060d with identifier: 1984834
2026-03-27 16:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f5cb23-1f97-5b4d-a867-b973fdba060d with scrape type 2
2026-03-27 16:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42f5cb23-1f97-5b4d-a867-b973fdba060d with scrape type 2
2026-03-27 16:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 42f5cb23-1f97-5b4d-a867-b973fdba060d, identifier: 1984834
2026-03-27 16:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 42f5cb23-1f97-5b4d-a867-b973fdba060d with identifier: 1984834
2026-03-27 16:39:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 42f5cb23-1f97-5b4d-a867-b973fdba060d with identifier: 1984834
2026-03-27 16:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 42f5cb23-1f97-5b4d-a867-b973fdba060d with identifier: 1984834 to the API
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARANCIO SICILIA EXTRASERIE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '42f5cb23-1f97-5b4d-a867-b973fdba060d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT PANDA CONSIP12 0.9 TWINAIR TURBO 85CV E6 S&S 6M 4X4 FP',
'odometer': 175378,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT PANDA CONSIP12 0.9 TWINAIR TURBO 85CV E6 S&S 6M 4X4 FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2017}
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984834%27 HTTP/1.1" 200 None
2026-03-27 16:39:04 [ayvens.it] INFO: Saving data for 1984834: {'auction_closing_time': 1774859400.0, 'created_time': 1774542946.967855, 'last_price_update_time': 1774629544.708179}
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984834') HTTP/1.1" 204 0
2026-03-27 16:39:04 [ayvens.it] INFO: Found listing with ID: 1984835
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984835%27 HTTP/1.1" 200 None
2026-03-27 16:39:04 [ayvens.it] INFO: Scrape type for 1984835: 2
2026-03-27 16:39:04 [ayvens.it] INFO: Extracting data for car ID: 1984835
2026-03-27 16:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51c6166a-65be-5950-832e-fd8469851815 with identifier: 1984835
2026-03-27 16:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51c6166a-65be-5950-832e-fd8469851815 with scrape type 2
2026-03-27 16:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51c6166a-65be-5950-832e-fd8469851815 with scrape type 2
2026-03-27 16:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 51c6166a-65be-5950-832e-fd8469851815, identifier: 1984835
2026-03-27 16:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 51c6166a-65be-5950-832e-fd8469851815 with identifier: 1984835
2026-03-27 16:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 51c6166a-65be-5950-832e-fd8469851815 with identifier: 1984835
2026-03-27 16:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 51c6166a-65be-5950-832e-fd8469851815 with identifier: 1984835 to the API
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Pure White pastello',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '51c6166a-65be-5950-832e-fd8469851815',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 137214,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN VOLKSWAGEN TIGUAN 2.0 TDI SCR 110KW Life DSG Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984835%27 HTTP/1.1" 200 None
2026-03-27 16:39:05 [ayvens.it] INFO: Saving data for 1984835: {'auction_closing_time': 1774859400.0, 'created_time': 1774542948.120425, 'last_price_update_time': 1774629545.091846}
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984835') HTTP/1.1" 204 0
2026-03-27 16:39:05 [ayvens.it] INFO: Found listing with ID: 1984836
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984836%27 HTTP/1.1" 200 None
2026-03-27 16:39:05 [ayvens.it] INFO: Scrape type for 1984836: 2
2026-03-27 16:39:05 [ayvens.it] INFO: Extracting data for car ID: 1984836
2026-03-27 16:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66fe1903-94c6-5c9e-a3fc-02d262104462 with identifier: 1984836
2026-03-27 16:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66fe1903-94c6-5c9e-a3fc-02d262104462 with scrape type 2
2026-03-27 16:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66fe1903-94c6-5c9e-a3fc-02d262104462 with scrape type 2
2026-03-27 16:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 66fe1903-94c6-5c9e-a3fc-02d262104462, identifier: 1984836
2026-03-27 16:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 66fe1903-94c6-5c9e-a3fc-02d262104462 with identifier: 1984836
2026-03-27 16:39:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 66fe1903-94c6-5c9e-a3fc-02d262104462 with identifier: 1984836
2026-03-27 16:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 66fe1903-94c6-5c9e-a3fc-02d262104462 with identifier: 1984836 to the API
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Metal Stream Met',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '66fe1903-94c6-5c9e-a3fc-02d262104462',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA C-HR 1.8H (122CV) E-CVT Business Sport utility vehicle '
'5-door (Euro 6.2)',
'odometer': 145024,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA C-HR 1.8H (122CV) E-CVT Business Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2018}
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984836%27 HTTP/1.1" 200 None
2026-03-27 16:39:05 [ayvens.it] INFO: Saving data for 1984836: {'auction_closing_time': 1774859400.0, 'created_time': 1774542949.979673, 'last_price_update_time': 1774629545.482697}
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984836') HTTP/1.1" 204 0
2026-03-27 16:39:05 [ayvens.it] INFO: Found listing with ID: 1984837
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984837%27 HTTP/1.1" 200 None
2026-03-27 16:39:05 [ayvens.it] INFO: Scrape type for 1984837: 2
2026-03-27 16:39:05 [ayvens.it] INFO: Extracting data for car ID: 1984837
2026-03-27 16:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4765c16-9be2-566a-bff7-07d89ba16769 with identifier: 1984837
2026-03-27 16:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4765c16-9be2-566a-bff7-07d89ba16769 with scrape type 2
2026-03-27 16:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4765c16-9be2-566a-bff7-07d89ba16769 with scrape type 2
2026-03-27 16:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: b4765c16-9be2-566a-bff7-07d89ba16769, identifier: 1984837
2026-03-27 16:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: b4765c16-9be2-566a-bff7-07d89ba16769 with identifier: 1984837
2026-03-27 16:39:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: b4765c16-9be2-566a-bff7-07d89ba16769 with identifier: 1984837
2026-03-27 16:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: b4765c16-9be2-566a-bff7-07d89ba16769 with identifier: 1984837 to the API
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO MADREPERLA TINTA SPECIALE',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'b4765c16-9be2-566a-bff7-07d89ba16769',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 5008 BLUEHDI 130 BUSINESS EAT8 S/S AUT. FP',
'odometer': 193307,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-19',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 5008 BLUEHDI 130 BUSINESS EAT8 S/S AUT. FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2019}
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984837%27 HTTP/1.1" 200 None
2026-03-27 16:39:05 [ayvens.it] INFO: Saving data for 1984837: {'auction_closing_time': 1774859400.0, 'created_time': 1774542951.583344, 'last_price_update_time': 1774629545.864857}
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984837') HTTP/1.1" 204 0
2026-03-27 16:39:05 [ayvens.it] INFO: Found listing with ID: 1984838
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984838%27 HTTP/1.1" 200 None
2026-03-27 16:39:05 [ayvens.it] INFO: Scrape type for 1984838: 2
2026-03-27 16:39:05 [ayvens.it] INFO: Extracting data for car ID: 1984838
2026-03-27 16:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05143d77-53a6-5134-bb1f-256adc62d8a0 with identifier: 1984838
2026-03-27 16:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05143d77-53a6-5134-bb1f-256adc62d8a0 with scrape type 2
2026-03-27 16:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05143d77-53a6-5134-bb1f-256adc62d8a0 with scrape type 2
2026-03-27 16:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 05143d77-53a6-5134-bb1f-256adc62d8a0, identifier: 1984838
2026-03-27 16:39:06 [scrapy.extensions.logstats] INFO: Crawled 17 pages (at -3 pages/min), scraped 397 items (at 107 items/min)
2026-03-27 16:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-27 16:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 05143d77-53a6-5134-bb1f-256adc62d8a0 with identifier: 1984838
2026-03-27 16:39:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 05143d77-53a6-5134-bb1f-256adc62d8a0 with identifier: 1984838
2026-03-27 16:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 05143d77-53a6-5134-bb1f-256adc62d8a0 with identifier: 1984838 to the API
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Shadow Black micalizzata',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '05143d77-53a6-5134-bb1f-256adc62d8a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD MONDEO 2.0 187cv Hybrid ecvT Auto Vignale SW 5-door (Euro 6.2)',
'odometer': 143420,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD MONDEO 2.0 187cv Hybrid ecvT Auto Vignale SW 5-door (Euro '
'6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2020}
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984838%27 HTTP/1.1" 200 None
2026-03-27 16:39:06 [ayvens.it] INFO: Saving data for 1984838: {'auction_closing_time': 1774859400.0, 'created_time': 1774542953.388099, 'last_price_update_time': 1774629546.323292}
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984838') HTTP/1.1" 204 0
2026-03-27 16:39:06 [ayvens.it] INFO: Found listing with ID: 1984839
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984839%27 HTTP/1.1" 200 None
2026-03-27 16:39:06 [ayvens.it] INFO: Scrape type for 1984839: 2
2026-03-27 16:39:06 [ayvens.it] INFO: Extracting data for car ID: 1984839
2026-03-27 16:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e52ace6-65d2-53b7-82fd-7bd45ec27fe4 with identifier: 1984839
2026-03-27 16:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e52ace6-65d2-53b7-82fd-7bd45ec27fe4 with scrape type 2
2026-03-27 16:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e52ace6-65d2-53b7-82fd-7bd45ec27fe4 with scrape type 2
2026-03-27 16:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 0e52ace6-65d2-53b7-82fd-7bd45ec27fe4, identifier: 1984839
2026-03-27 16:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 0e52ace6-65d2-53b7-82fd-7bd45ec27fe4 with identifier: 1984839
2026-03-27 16:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 0e52ace6-65d2-53b7-82fd-7bd45ec27fe4 with identifier: 1984839
2026-03-27 16:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 0e52ace6-65d2-53b7-82fd-7bd45ec27fe4 with identifier: 1984839 to the API
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SUPER RED',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '0e52ace6-65d2-53b7-82fd-7bd45ec27fe4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP',
'odometer': 85356,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA SW N1 TS HYBRID BUSINESS TECH FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984839%27 HTTP/1.1" 200 None
2026-03-27 16:39:06 [ayvens.it] INFO: Saving data for 1984839: {'auction_closing_time': 1774859400.0, 'created_time': 1774542955.480135, 'last_price_update_time': 1774629546.664281}
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984839') HTTP/1.1" 204 0
2026-03-27 16:39:06 [ayvens.it] INFO: Found listing with ID: 1984840
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984840%27 HTTP/1.1" 200 None
2026-03-27 16:39:06 [ayvens.it] INFO: Scrape type for 1984840: 2
2026-03-27 16:39:06 [ayvens.it] INFO: Extracting data for car ID: 1984840
2026-03-27 16:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c6a7190-9968-5fab-adbf-bf3ab57a1364 with identifier: 1984840
2026-03-27 16:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6a7190-9968-5fab-adbf-bf3ab57a1364 with scrape type 2
2026-03-27 16:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c6a7190-9968-5fab-adbf-bf3ab57a1364 with scrape type 2
2026-03-27 16:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4c6a7190-9968-5fab-adbf-bf3ab57a1364, identifier: 1984840
2026-03-27 16:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4c6a7190-9968-5fab-adbf-bf3ab57a1364 with identifier: 1984840
2026-03-27 16:39:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4c6a7190-9968-5fab-adbf-bf3ab57a1364 with identifier: 1984840
2026-03-27 16:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4c6a7190-9968-5fab-adbf-bf3ab57a1364 with identifier: 1984840 to the API
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio Platinium metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '4c6a7190-9968-5fab-adbf-bf3ab57a1364',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 PureTech Turbo 130 EAT8 S&S Allure Sport utility '
'vehicle 5-door (Euro 6D)',
'odometer': 24442,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 PureTech Turbo 130 EAT8 S&S Allure Sport '
'utility vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984840%27 HTTP/1.1" 200 None
2026-03-27 16:39:07 [ayvens.it] INFO: Saving data for 1984840: {'auction_closing_time': 1774859400.0, 'created_time': 1774542956.945489, 'last_price_update_time': 1774629547.029449}
2026-03-27 16:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984840') HTTP/1.1" 204 0
2026-03-27 16:39:07 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-27 16:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:39:08 [ayvens.it] INFO: Found listing with ID: 1984841
2026-03-27 16:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984841%27 HTTP/1.1" 200 None
2026-03-27 16:39:08 [ayvens.it] INFO: Scrape type for 1984841: 2
2026-03-27 16:39:08 [ayvens.it] INFO: Extracting data for car ID: 1984841
2026-03-27 16:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df818891-c952-50a9-ab5b-f5f4d35e34df with identifier: 1984841
2026-03-27 16:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df818891-c952-50a9-ab5b-f5f4d35e34df with scrape type 2
2026-03-27 16:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df818891-c952-50a9-ab5b-f5f4d35e34df with scrape type 2
2026-03-27 16:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: df818891-c952-50a9-ab5b-f5f4d35e34df, identifier: 1984841
2026-03-27 16:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: df818891-c952-50a9-ab5b-f5f4d35e34df with identifier: 1984841
2026-03-27 16:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: df818891-c952-50a9-ab5b-f5f4d35e34df with identifier: 1984841
2026-03-27 16:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: df818891-c952-50a9-ab5b-f5f4d35e34df with identifier: 1984841 to the API
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLUE CELEBES METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'df818891-c952-50a9-ab5b-f5f4d35e34df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ACTIVE PACK FP',
'odometer': 85255,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 3008 (PC) BLUEHDI 130 EAT8 S&S ACTIVE PACK FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984841%27 HTTP/1.1" 200 None
2026-03-27 16:39:09 [ayvens.it] INFO: Saving data for 1984841: {'auction_closing_time': 1774859400.0, 'created_time': 1774542958.510519, 'last_price_update_time': 1774629549.159253}
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984841') HTTP/1.1" 204 0
2026-03-27 16:39:09 [ayvens.it] INFO: Found listing with ID: 1984842
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984842%27 HTTP/1.1" 200 None
2026-03-27 16:39:09 [ayvens.it] INFO: Scrape type for 1984842: 2
2026-03-27 16:39:09 [ayvens.it] INFO: Extracting data for car ID: 1984842
2026-03-27 16:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99292b11-90f9-5374-97f5-63b14941942e with identifier: 1984842
2026-03-27 16:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99292b11-90f9-5374-97f5-63b14941942e with scrape type 2
2026-03-27 16:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99292b11-90f9-5374-97f5-63b14941942e with scrape type 2
2026-03-27 16:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 99292b11-90f9-5374-97f5-63b14941942e, identifier: 1984842
2026-03-27 16:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 99292b11-90f9-5374-97f5-63b14941942e with identifier: 1984842
2026-03-27 16:39:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 99292b11-90f9-5374-97f5-63b14941942e with identifier: 1984842
2026-03-27 16:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 99292b11-90f9-5374-97f5-63b14941942e with identifier: 1984842 to the API
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Unknown',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '99292b11-90f9-5374-97f5-63b14941942e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2)',
'odometer': 134989,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD PUMA 1.0 Ecoboost Hybrid 125CV ST-Line Auto Sport utility '
'vehicle 5-door (Euro 6.2) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984842%27 HTTP/1.1" 200 None
2026-03-27 16:39:09 [ayvens.it] INFO: Saving data for 1984842: {'auction_closing_time': 1774859400.0, 'created_time': 1774542960.972734, 'last_price_update_time': 1774629549.509283}
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984842') HTTP/1.1" 204 0
2026-03-27 16:39:09 [ayvens.it] INFO: Found listing with ID: 1984843
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984843%27 HTTP/1.1" 200 None
2026-03-27 16:39:09 [ayvens.it] INFO: Scrape type for 1984843: 2
2026-03-27 16:39:09 [ayvens.it] INFO: Extracting data for car ID: 1984843
2026-03-27 16:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 576c891f-7b21-5c68-9200-9b0b651a8c34 with identifier: 1984843
2026-03-27 16:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 576c891f-7b21-5c68-9200-9b0b651a8c34 with scrape type 2
2026-03-27 16:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 576c891f-7b21-5c68-9200-9b0b651a8c34 with scrape type 2
2026-03-27 16:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 576c891f-7b21-5c68-9200-9b0b651a8c34, identifier: 1984843
2026-03-27 16:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 576c891f-7b21-5c68-9200-9b0b651a8c34 with identifier: 1984843
2026-03-27 16:39:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 576c891f-7b21-5c68-9200-9b0b651a8c34 with identifier: 1984843
2026-03-27 16:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 576c891f-7b21-5c68-9200-9b0b651a8c34 with identifier: 1984843 to the API
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Blu Elegante metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '576c891f-7b21-5c68-9200-9b0b651a8c34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'LANCIA',
'model': 'LANCIA YPSILON ECOCHIC 1.0 FireFly 70cv S&S Hybrid SILVER Hatchback '
'5-door (Euro 6D)',
'odometer': 109736,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'LANCIA LANCIA YPSILON ECOCHIC 1.0 FireFly 70cv S&S Hybrid SILVER '
'Hatchback 5-door (Euro 6D) -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984843%27 HTTP/1.1" 200 None
2026-03-27 16:39:09 [ayvens.it] INFO: Saving data for 1984843: {'auction_closing_time': 1774859400.0, 'created_time': 1774542962.365116, 'last_price_update_time': 1774629549.886356}
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984843') HTTP/1.1" 204 0
2026-03-27 16:39:09 [ayvens.it] INFO: Found listing with ID: 1984844
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984844%27 HTTP/1.1" 200 None
2026-03-27 16:39:09 [ayvens.it] INFO: Scrape type for 1984844: 2
2026-03-27 16:39:09 [ayvens.it] INFO: Extracting data for car ID: 1984844
2026-03-27 16:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08850685-3625-58c3-9b9f-872c050b8671 with identifier: 1984844
2026-03-27 16:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08850685-3625-58c3-9b9f-872c050b8671 with scrape type 2
2026-03-27 16:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08850685-3625-58c3-9b9f-872c050b8671 with scrape type 2
2026-03-27 16:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 08850685-3625-58c3-9b9f-872c050b8671, identifier: 1984844
2026-03-27 16:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 08850685-3625-58c3-9b9f-872c050b8671 with identifier: 1984844
2026-03-27 16:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 08850685-3625-58c3-9b9f-872c050b8671 with identifier: 1984844
2026-03-27 16:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 08850685-3625-58c3-9b9f-872c050b8671 with identifier: 1984844 to the API
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BIANCO',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '08850685-3625-58c3-9b9f-872c050b8671',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': 'FIAT DOBLO CARGO (PC CH1 BUSINESS 1.6 MJET 90CV E6D-F S&S FP',
'odometer': 293275,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'FIAT FIAT DOBLO CARGO (PC CH1 BUSINESS 1.6 MJET 90CV E6D-F S&S FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984844%27 HTTP/1.1" 200 None
2026-03-27 16:39:10 [ayvens.it] INFO: Saving data for 1984844: {'auction_closing_time': 1774859400.0, 'created_time': 1774542963.294877, 'last_price_update_time': 1774629550.306389}
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984844') HTTP/1.1" 204 0
2026-03-27 16:39:10 [ayvens.it] INFO: Found listing with ID: 1984845
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984845%27 HTTP/1.1" 200 None
2026-03-27 16:39:10 [ayvens.it] INFO: Scrape type for 1984845: 2
2026-03-27 16:39:10 [ayvens.it] INFO: Extracting data for car ID: 1984845
2026-03-27 16:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af564aa1-449e-5596-bdc0-538311ab297d with identifier: 1984845
2026-03-27 16:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af564aa1-449e-5596-bdc0-538311ab297d with scrape type 2
2026-03-27 16:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af564aa1-449e-5596-bdc0-538311ab297d with scrape type 2
2026-03-27 16:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af564aa1-449e-5596-bdc0-538311ab297d, identifier: 1984845
2026-03-27 16:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af564aa1-449e-5596-bdc0-538311ab297d with identifier: 1984845
2026-03-27 16:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af564aa1-449e-5596-bdc0-538311ab297d with identifier: 1984845
2026-03-27 16:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af564aa1-449e-5596-bdc0-538311ab297d with identifier: 1984845 to the API
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'Grigio graphite metallizzato',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'af564aa1-449e-5596-bdc0-538311ab297d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'SKODA OCTAVIA WAGON 2.0 TDI EVO 110KW EXECUTIVE DSG SW 5-door (Euro '
'6D)',
'odometer': 131996,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA SKODA OCTAVIA WAGON 2.0 TDI EVO 110KW EXECUTIVE DSG SW 5-door '
'(Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984845%27 HTTP/1.1" 200 None
2026-03-27 16:39:10 [ayvens.it] INFO: Saving data for 1984845: {'auction_closing_time': 1774859400.0, 'created_time': 1774542964.939878, 'last_price_update_time': 1774629550.682095}
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984845') HTTP/1.1" 204 0
2026-03-27 16:39:10 [ayvens.it] INFO: Found listing with ID: 1984846
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984846%27 HTTP/1.1" 200 None
2026-03-27 16:39:10 [ayvens.it] INFO: Scrape type for 1984846: 2
2026-03-27 16:39:10 [ayvens.it] INFO: Extracting data for car ID: 1984846
2026-03-27 16:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 749cc839-b6d5-531e-8d2e-82627dfac2cc with identifier: 1984846
2026-03-27 16:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 749cc839-b6d5-531e-8d2e-82627dfac2cc with scrape type 2
2026-03-27 16:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 749cc839-b6d5-531e-8d2e-82627dfac2cc with scrape type 2
2026-03-27 16:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 749cc839-b6d5-531e-8d2e-82627dfac2cc, identifier: 1984846
2026-03-27 16:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 749cc839-b6d5-531e-8d2e-82627dfac2cc with identifier: 1984846
2026-03-27 16:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 749cc839-b6d5-531e-8d2e-82627dfac2cc with identifier: 1984846
2026-03-27 16:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 749cc839-b6d5-531e-8d2e-82627dfac2cc with identifier: 1984846 to the API
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO DAYTONA PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '749cc839-b6d5-531e-8d2e-82627dfac2cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 (PC) 35 TDI S TRONIC S LINE EDITION FP',
'odometer': 176874,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 (PC) 35 TDI S TRONIC S LINE EDITION FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984846%27 HTTP/1.1" 200 None
2026-03-27 16:39:11 [ayvens.it] INFO: Saving data for 1984846: {'auction_closing_time': 1774859400.0, 'created_time': 1774542967.0926, 'last_price_update_time': 1774629551.021572}
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984846') HTTP/1.1" 204 0
2026-03-27 16:39:11 [ayvens.it] INFO: Found listing with ID: 1984847
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984847%27 HTTP/1.1" 200 None
2026-03-27 16:39:11 [ayvens.it] INFO: Scrape type for 1984847: 2
2026-03-27 16:39:11 [ayvens.it] INFO: Extracting data for car ID: 1984847
2026-03-27 16:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c465f71-e258-55b5-bdad-7001c778d9d4 with identifier: 1984847
2026-03-27 16:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c465f71-e258-55b5-bdad-7001c778d9d4 with scrape type 2
2026-03-27 16:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c465f71-e258-55b5-bdad-7001c778d9d4 with scrape type 2
2026-03-27 16:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 2c465f71-e258-55b5-bdad-7001c778d9d4, identifier: 1984847
2026-03-27 16:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 2c465f71-e258-55b5-bdad-7001c778d9d4 with identifier: 1984847
2026-03-27 16:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 2c465f71-e258-55b5-bdad-7001c778d9d4 with identifier: 1984847
2026-03-27 16:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 2c465f71-e258-55b5-bdad-7001c778d9d4 with identifier: 1984847 to the API
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '2c465f71-e258-55b5-bdad-7001c778d9d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MITSUBISHI',
'model': 'MITSUBISHI SPACE STAR 1.2 INTENSE SDA FP',
'odometer': 72002,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'MITSUBISHI MITSUBISHI SPACE STAR 1.2 INTENSE SDA FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984847%27 HTTP/1.1" 200 None
2026-03-27 16:39:11 [ayvens.it] INFO: Saving data for 1984847: {'auction_closing_time': 1774859400.0, 'created_time': 1774542968.417838, 'last_price_update_time': 1774629551.373254}
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984847') HTTP/1.1" 204 0
2026-03-27 16:39:11 [ayvens.it] INFO: Found listing with ID: 1984848
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984848%27 HTTP/1.1" 200 None
2026-03-27 16:39:11 [ayvens.it] INFO: Scrape type for 1984848: 2
2026-03-27 16:39:11 [ayvens.it] INFO: Extracting data for car ID: 1984848
2026-03-27 16:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af2bc170-8878-5360-9129-6daa7350ab8a with identifier: 1984848
2026-03-27 16:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af2bc170-8878-5360-9129-6daa7350ab8a with scrape type 2
2026-03-27 16:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af2bc170-8878-5360-9129-6daa7350ab8a with scrape type 2
2026-03-27 16:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: af2bc170-8878-5360-9129-6daa7350ab8a, identifier: 1984848
2026-03-27 16:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: af2bc170-8878-5360-9129-6daa7350ab8a with identifier: 1984848
2026-03-27 16:39:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: af2bc170-8878-5360-9129-6daa7350ab8a with identifier: 1984848
2026-03-27 16:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: af2bc170-8878-5360-9129-6daa7350ab8a with identifier: 1984848 to the API
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'ARANCIO CORALLO MET',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'af2bc170-8878-5360-9129-6daa7350ab8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI A4 SW (PC) 2.0 35 TDI BUSINESS S TRONIC FP',
'odometer': 158246,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI A4 SW (PC) 2.0 35 TDI BUSINESS S TRONIC FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2023}
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984848%27 HTTP/1.1" 200 None
2026-03-27 16:39:11 [ayvens.it] INFO: Saving data for 1984848: {'auction_closing_time': 1774859400.0, 'created_time': 1774542970.937084, 'last_price_update_time': 1774629551.770382}
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984848') HTTP/1.1" 204 0
2026-03-27 16:39:11 [ayvens.it] INFO: Found listing with ID: 1984849
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984849%27 HTTP/1.1" 200 None
2026-03-27 16:39:11 [ayvens.it] INFO: Scrape type for 1984849: 2
2026-03-27 16:39:11 [ayvens.it] INFO: Extracting data for car ID: 1984849
2026-03-27 16:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1426da-d0df-5426-8a04-2bded929f92b with identifier: 1984849
2026-03-27 16:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1426da-d0df-5426-8a04-2bded929f92b with scrape type 2
2026-03-27 16:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f1426da-d0df-5426-8a04-2bded929f92b with scrape type 2
2026-03-27 16:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 7f1426da-d0df-5426-8a04-2bded929f92b, identifier: 1984849
2026-03-27 16:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 7f1426da-d0df-5426-8a04-2bded929f92b with identifier: 1984849
2026-03-27 16:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 7f1426da-d0df-5426-8a04-2bded929f92b with identifier: 1984849
2026-03-27 16:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 7f1426da-d0df-5426-8a04-2bded929f92b with identifier: 1984849 to the API
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIGIO CHRONOS METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': '7f1426da-d0df-5426-8a04-2bded929f92b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'AUDI Q3 45 TFSI e S tronic S Line Edition Sport utility vehicle '
'5-door (Euro 6D)',
'odometer': 145736,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-09',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI AUDI Q3 45 TFSI e S tronic S Line Edition Sport utility '
'vehicle 5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984849%27 HTTP/1.1" 200 None
2026-03-27 16:39:12 [ayvens.it] INFO: Saving data for 1984849: {'auction_closing_time': 1774859400.0, 'created_time': 1774542972.76528, 'last_price_update_time': 1774629552.190354}
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984849') HTTP/1.1" 204 0
2026-03-27 16:39:12 [ayvens.it] INFO: Found listing with ID: 1984850
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984850%27 HTTP/1.1" 200 None
2026-03-27 16:39:12 [ayvens.it] INFO: Scrape type for 1984850: 2
2026-03-27 16:39:12 [ayvens.it] INFO: Extracting data for car ID: 1984850
2026-03-27 16:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2c4d202-11c9-538c-a6c4-bb86a1d43c73 with identifier: 1984850
2026-03-27 16:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c4d202-11c9-538c-a6c4-bb86a1d43c73 with scrape type 2
2026-03-27 16:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2c4d202-11c9-538c-a6c4-bb86a1d43c73 with scrape type 2
2026-03-27 16:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d2c4d202-11c9-538c-a6c4-bb86a1d43c73, identifier: 1984850
2026-03-27 16:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d2c4d202-11c9-538c-a6c4-bb86a1d43c73 with identifier: 1984850
2026-03-27 16:39:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d2c4d202-11c9-538c-a6c4-bb86a1d43c73 with identifier: 1984850
2026-03-27 16:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d2c4d202-11c9-538c-a6c4-bb86a1d43c73 with identifier: 1984850 to the API
2026-03-27 16:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NERO PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': 'd2c4d202-11c9-538c-a6c4-bb86a1d43c73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PEUGEOT 508 SW BlueHDi 130 Active Pack SW S/S EAT8 SW 5-door (Euro '
'6D)',
'odometer': 89254,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT PEUGEOT 508 SW BlueHDi 130 Active Pack SW S/S EAT8 SW '
'5-door (Euro 6D) -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984850%27 HTTP/1.1" 200 None
2026-03-27 16:39:13 [ayvens.it] INFO: Saving data for 1984850: {'auction_closing_time': 1774859400.0, 'created_time': 1774542975.435681, 'last_price_update_time': 1774629553.158602}
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984850') HTTP/1.1" 204 0
2026-03-27 16:39:13 [ayvens.it] INFO: Found listing with ID: 1984851
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984851%27 HTTP/1.1" 200 None
2026-03-27 16:39:13 [ayvens.it] INFO: Scrape type for 1984851: 2
2026-03-27 16:39:13 [ayvens.it] INFO: Extracting data for car ID: 1984851
2026-03-27 16:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612bf796-a6dc-5da8-a72b-97b729e99f6f with identifier: 1984851
2026-03-27 16:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612bf796-a6dc-5da8-a72b-97b729e99f6f with scrape type 2
2026-03-27 16:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612bf796-a6dc-5da8-a72b-97b729e99f6f with scrape type 2
2026-03-27 16:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 612bf796-a6dc-5da8-a72b-97b729e99f6f, identifier: 1984851
2026-03-27 16:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 612bf796-a6dc-5da8-a72b-97b729e99f6f with identifier: 1984851
2026-03-27 16:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 612bf796-a6dc-5da8-a72b-97b729e99f6f with identifier: 1984851
2026-03-27 16:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 612bf796-a6dc-5da8-a72b-97b729e99f6f with identifier: 1984851 to the API
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'MAGNETIC GREY METALLIZZATO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '612bf796-a6dc-5da8-a72b-97b729e99f6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD KUGA (PC) 1.5 ECOBLUE 120CV 2WD ST-LINE AUTO FP',
'odometer': 108149,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD KUGA (PC) 1.5 ECOBLUE 120CV 2WD ST-LINE AUTO FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984851%27 HTTP/1.1" 200 None
2026-03-27 16:39:13 [ayvens.it] INFO: Saving data for 1984851: {'auction_closing_time': 1774859400.0, 'created_time': 1774542977.552841, 'last_price_update_time': 1774629553.475576}
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984851') HTTP/1.1" 204 0
2026-03-27 16:39:13 [ayvens.it] INFO: Found listing with ID: 1984852
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984852%27 HTTP/1.1" 200 None
2026-03-27 16:39:13 [ayvens.it] INFO: Scrape type for 1984852: 2
2026-03-27 16:39:13 [ayvens.it] INFO: Extracting data for car ID: 1984852
2026-03-27 16:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4e705a9-7302-5335-9635-257001f915a5 with identifier: 1984852
2026-03-27 16:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4e705a9-7302-5335-9635-257001f915a5 with scrape type 2
2026-03-27 16:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4e705a9-7302-5335-9635-257001f915a5 with scrape type 2
2026-03-27 16:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: d4e705a9-7302-5335-9635-257001f915a5, identifier: 1984852
2026-03-27 16:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: d4e705a9-7302-5335-9635-257001f915a5 with identifier: 1984852
2026-03-27 16:39:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: d4e705a9-7302-5335-9635-257001f915a5 with identifier: 1984852
2026-03-27 16:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: d4e705a9-7302-5335-9635-257001f915a5 with identifier: 1984852 to the API
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'SUPER WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'hybrid',
'id': 'd4e705a9-7302-5335-9635-257001f915a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'TOYOTA COROLLA (PC) TS HYBRID BUSINESS FP',
'odometer': 94576,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA TOYOTA COROLLA (PC) TS HYBRID BUSINESS FP -',
'transmission': 'automatic',
'trim': '-',
'vin': None,
'year': 2021}
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984852%27 HTTP/1.1" 200 None
2026-03-27 16:39:13 [ayvens.it] INFO: Saving data for 1984852: {'auction_closing_time': 1774859400.0, 'created_time': 1774542979.067531, 'last_price_update_time': 1774629553.867573}
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984852') HTTP/1.1" 204 0
2026-03-27 16:39:13 [ayvens.it] INFO: Found listing with ID: 1984853
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984853%27 HTTP/1.1" 200 None
2026-03-27 16:39:13 [ayvens.it] INFO: Scrape type for 1984853: 2
2026-03-27 16:39:13 [ayvens.it] INFO: Extracting data for car ID: 1984853
2026-03-27 16:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c8e8bfd-6f76-5005-87ab-676b23adb54b with identifier: 1984853
2026-03-27 16:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c8e8bfd-6f76-5005-87ab-676b23adb54b with scrape type 2
2026-03-27 16:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c8e8bfd-6f76-5005-87ab-676b23adb54b with scrape type 2
2026-03-27 16:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 1c8e8bfd-6f76-5005-87ab-676b23adb54b, identifier: 1984853
2026-03-27 16:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 1c8e8bfd-6f76-5005-87ab-676b23adb54b with identifier: 1984853
2026-03-27 16:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 1c8e8bfd-6f76-5005-87ab-676b23adb54b with identifier: 1984853
2026-03-27 16:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 1c8e8bfd-6f76-5005-87ab-676b23adb54b with identifier: 1984853 to the API
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'WHITE PASTELLO',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'petrol',
'id': '1c8e8bfd-6f76-5005-87ab-676b23adb54b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'MITSUBISHI',
'model': 'MITSUBISHI SPACE STAR 1.2 INTENSE SDA FP',
'odometer': 83965,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'MITSUBISHI MITSUBISHI SPACE STAR 1.2 INTENSE SDA FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2022}
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984853%27 HTTP/1.1" 200 None
2026-03-27 16:39:14 [ayvens.it] INFO: Saving data for 1984853: {'auction_closing_time': 1774859400.0, 'created_time': 1774542980.488284, 'last_price_update_time': 1774629554.220452}
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984853') HTTP/1.1" 204 0
2026-03-27 16:39:14 [ayvens.it] INFO: Found listing with ID: 1984854
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984854%27 HTTP/1.1" 200 None
2026-03-27 16:39:14 [ayvens.it] INFO: Scrape type for 1984854: 2
2026-03-27 16:39:14 [ayvens.it] INFO: Extracting data for car ID: 1984854
2026-03-27 16:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f32c432-6566-5c13-b887-477af27b3682 with identifier: 1984854
2026-03-27 16:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f32c432-6566-5c13-b887-477af27b3682 with scrape type 2
2026-03-27 16:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f32c432-6566-5c13-b887-477af27b3682 with scrape type 2
2026-03-27 16:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.it, Processed item id: 4f32c432-6566-5c13-b887-477af27b3682, identifier: 1984854
2026-03-27 16:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.it, Translating item: 4f32c432-6566-5c13-b887-477af27b3682 with identifier: 1984854
2026-03-27 16:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.it, Applying rules to item: 4f32c432-6566-5c13-b887-477af27b3682 with identifier: 1984854
2026-03-27 16:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.it, Posting item: 4f32c432-6566-5c13-b887-477af27b3682 with identifier: 1984854 to the API
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'FROZEN WHITE',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T08:30:00Z',
'fuel_type': 'diesel',
'id': '4f32c432-6566-5c13-b887-477af27b3682',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41063',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FORD TRANSIT CAB(PC) T/P 350 L3 TREND 2.0 ECO 130 CV HDT FP',
'odometer': 23074,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FORD TRANSIT CAB(PC) T/P 350 L3 TREND 2.0 ECO 130 CV HDT FP -',
'transmission': 'manual',
'trim': '-',
'vin': None,
'year': 2024}
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20RowKey%20eq%20%271984854%27 HTTP/1.1" 200 None
2026-03-27 16:39:14 [ayvens.it] INFO: Saving data for 1984854: {'auction_closing_time': 1774859400.0, 'created_time': 1774542986.672328, 'last_price_update_time': 1774629554.581522}
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.it',RowKey='1984854') HTTP/1.1" 204 0
2026-03-27 16:39:14 [ayvens.it] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-27 16:39:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:39:16 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 16:39:16 [ayvens.it] INFO: ayvens.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 6, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-27 16:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.it%27%20and%20last_price_update_time%20lt%201774197556 HTTP/1.1" 200 None
2026-03-27 16:39:16 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (414 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.it/task_39_2026-03-27T16_30_00.jl
2026-03-27 16:39:16 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1100419,
'downloader/request_count': 2367,
'downloader/request_method_count/GET': 2361,
'downloader/request_method_count/POST': 6,
'downloader/response_bytes': 1418999342,
'downloader/response_count': 2367,
'downloader/response_status_count/200': 2355,
'downloader/response_status_count/404': 12,
'elapsed_time_seconds': 550.235184,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 27, 16, 39, 16, 158036, tzinfo=datetime.timezone.utc),
'item_scraped_count': 414,
'log_count/DEBUG': 21064,
'log_count/INFO': 21828,
'memusage/max': 198057984,
'memusage/startup': 147918848,
'photo_download_count': 2348,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 160,
'playwright/request_count/aborted': 15,
'playwright/request_count/method/GET': 151,
'playwright/request_count/method/POST': 9,
'playwright/request_count/navigation': 5,
'playwright/request_count/resource_type/document': 5,
'playwright/request_count/resource_type/fetch': 10,
'playwright/request_count/resource_type/font': 16,
'playwright/request_count/resource_type/image': 34,
'playwright/request_count/resource_type/other': 1,
'playwright/request_count/resource_type/script': 88,
'playwright/request_count/resource_type/stylesheet': 1,
'playwright/request_count/resource_type/xhr': 5,
'playwright/response_count': 134,
'playwright/response_count/method/GET': 131,
'playwright/response_count/method/POST': 3,
'playwright/response_count/resource_type/document': 2,
'playwright/response_count/resource_type/fetch': 5,
'playwright/response_count/resource_type/font': 16,
'playwright/response_count/resource_type/image': 18,
'playwright/response_count/resource_type/script': 88,
'playwright/response_count/resource_type/stylesheet': 1,
'playwright/response_count/resource_type/xhr': 4,
'request_depth_max': 6,
'response_received_count': 19,
'scheduler/dequeued': 2367,
'scheduler/dequeued/memory': 2367,
'scheduler/enqueued': 2367,
'scheduler/enqueued/memory': 2367,
'scrape_type/new': 236,
'scrape_type/price_update': 178,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 6,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 3.063685295948138,
'scrapy-zyte-api/mean_response_seconds': 3.3854878826532513,
'scrapy-zyte-api/processed': 6,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 6,
'scrapy-zyte-api/request_args/experimental.responseCookies': 6,
'scrapy-zyte-api/request_args/httpRequestBody': 6,
'scrapy-zyte-api/request_args/httpRequestMethod': 6,
'scrapy-zyte-api/request_args/httpResponseBody': 6,
'scrapy-zyte-api/request_args/httpResponseHeaders': 6,
'scrapy-zyte-api/request_args/url': 6,
'scrapy-zyte-api/status_codes/200': 6,
'scrapy-zyte-api/success': 6,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 27, 16, 30, 5, 922852, tzinfo=datetime.timezone.utc)}
2026-03-27 16:39:16 [scrapy.core.engine] INFO: Spider closed (finished)